Based on your picture, the lines and grooves I see show no indication of any carbon fibers being cut or impacted by the rough surface. I do not see any grinding where the CF fibers are impacted. The area you indicated above your red arrows are of little structural concern to me. Depending on how far below the rough ground surface the fibers are, those rough areas are not load bearing. The carbon fiber strands/fibers and their orientation are what do the heavy work in the fork tube. The Epoxy is fairly flexible helps distribute the loads throughout all if the CF fibers. You don't need much epoxy above the outside of the fork tube fiber bundle to do it's job.
When I look at the image, I am more concerned with the roughness of the hole for the brake line. I can see many rough notches around the hole. Depending on how the fork tube flexes these rough areas around the hole could become stress propagation areas that could lead to cracks in The carbon fiber If this was my fork, and I was stuck with it, I would very carefully smooth out the rough edges around the hole and observe it any of the small notches penetrate deeper into the fork tube.
I would also sand down the rough areas that you indicated to a smoother surface and look for any carbon fiber strands becoming visible. If the carbon fibers become exposed, then that rough area would become a concern.