I managed to figure out the problem! I had a bad connection on the Vusb pin.
It now works fine in both full speed and low speed from the internal oscillator. Thanks for everyones help.
I am having a problem with the PIC18F26J50, specifically with USB. I was perviously using the PIC18F14K50 with great success but have run up against a brick wall with this chip.