The Ministry of Justice is considering banning prison sentences of less than six months in England and Wales.
Ministers argue that short jail terms are less effective at cutting reoffending than community penalties.
Prisons minister Rory Stewart told the Daily Telegraph that such sentences were "long enough to damage you and not long enough to heal you".
If such jail sentences were to be scrapped, it is thought it could free up thousands of prison places.
Some 30,000 criminals, including burglars and most shoplifters, could be spared jail every year under the proposals, the Telegraph reports.
Offenders could face sanctions such as community sentences but no alternative penalties have been confirmed.
Overall, the measure could reduce the prison population by about 3,500, although it would require legislation.
The Ministry of Justice is now considering preventing courts from imposing prison terms of less than six months unless the sentence is for a violent crime or a sexual offence.
Arguing for the need for reform, Mr Stewart told the Daily Telegraph Magazine: "You bring somebody in for three or four weeks, they lose their house, their job, their family, their reputation.
"They come (into prison), they meet a lot of interesting characters (to put it politely) and then you whap them on to the streets again.
"The public are safer if we have a good community sentence... and it will relieve a lot of pressure on prisons."
Since they took up their posts last year, Justice Secretary David Gauke and Mr Stewart have both made it clear they want to reduce the use of short prison sentences.
The prison population has doubled in England and Wales since the early 1990s, rising from about 40,000 to more than 80,000 in 2018, official figures show.
Almost two-thirds of prisoners released after sentences of less than 12 months reoffend within a year.
More than half of the 86,275 offenders sentenced to immediate custody in England and Wales in 2017 were handed sentences of six months or less, according to a Parliamentary response from Mr Stewart last month.
