You can replace with either wood or mortar, whichever you prefer. I've replaced with wood on a few occasions and it's fairly difficult to get the old out and surprisingly tough to get the new back in. Using mortar would ease things considerably and if you wanted something interesting, you could use color dye in the mortar to off-set the expansion joints from the patio slabs.