Thats kindda my issue with FSD, it doesnt always work so you have to pay close attention, its jerky (so if there is someone running across the street a block ahead it will slow even though you know they will be on the sidewalk soon), and it still has glitches (in my case it would sometimes stop...