The directed movement of substances along cytoskeletal fibers such as microfilaments or microtubules within a cell.