Same here man, but if you know the low E then obviously you also know the high E, so you know 4 strings all together, and for the B and G strings I just look at their octaves on the lower strings.
But anyway, yeah, guitar is a very very difficult instrument to master.
EDIT: also, for learning all the notes, there's a program called "fretboard warrior" that you should look up