The speed will be related to escape speed of sun. Based on https://en.m.wikipedia.org/wiki/Escape_velocity It will be Vte which is 16.6 km/s (or Ve 42.1). So when object at earth orbit and has lower speed than 16.6 it can’t keep the orbit and will slowly fall into sun.