Exhaust leak. Check all hoses/clamps.
Exhaust fumes can fill the engine bay, and starve the engine of fresh air and choke it out.
Sitting for a while allows the fumes to dissipate and allow the ski to run until they build up again.
To test this theory, ride with the seat off, allowing maximum air circulation.