Unfortunately you can't, the iPad has to connect to the goggles, can't connect directly to the RC.
If you already have the goggles you can see if by any chance it works out of the box but if they're not paired yet you won't be able to pair them without the avata...