Use a tool designed to remove sealed wheel bearings from a Harley Davidson.
Your attempted method tells us you are not working with a service manual.
These bearings are not removed the same way as on a Honda, a factory Service Manual will show you exactly how to remove and replace the bearings.
Here`s one company that makes the tool:
Aftermarket Harley Davidson Motorcycle Parts | JIMS USA
