Modi's ruling Bharatiya Janata Party lost its own majority in parliament for the first time in a decade and is dependent on its regional allies to get past the half-way mark required to run the world's largest democracy.
For Modi whose approval ratings have been the highest among world leaders and who ran a presidential-style campaign, such a result is the first sign of the ground shifting.
"For the BJP to drop below the majority mark, this is a personal setback for him," said Yogendra Yadav, a psephologist and the founder of a small political group opposed to the BJP.
Since he took power 10 years ago, riding his Hindu nationalist base, Modi has been the ruling alliance's unquestioned leader, with concerns growing about what his opponents see as the country's slide towards authoritarianism.
The man who as a boy sold tea in his home state of Gujarat has dominated India's politics so completely in the last decade that few in his party or even the parent ideological group, the Rashtriya Swayamsevak Sangh, dare stand up to him.
Indeed, throughout the campaign in scorching heat, it was Modi with his thinning white hair, a neatly trimmed white beard and immaculate Indian attire who towered over everyone else.
His giant cutouts were everywhere, his face on television screens every day as he courted India's 968 million voters with a personal "Modi guarantee" to change their lives.
"My sole issue with Modi today is that he has become larger than the party itself," said Surendra Kumar Dwivedi, a former head of the Department of Political Science at Lucknow University "In a democratic system... a party should always supersede an individual."
'LAST 10 YEARS IS ONLY A PREVIEW'
Still, Modi will be only the second leader to win a third term after founding prime minister Jawaharlal Nehru and has promised a transformative next five years.
Under him, India has become the world's fastest growing major economy and he has said he wants to make it the world's third largest in three years, behind the United States and China.
"What we have done in the last 10 years is only a preview, a trailer," Modi told a recent rally. "We have a lot more to do. Modi is taking the country to a different level in the world."
The BJP has dismissed opposition speculation that Modi, 73, might hang up his boots once he reaches 75, like some other party leaders have done in recent years. Modi has said he wants to lay the groundwork for India to become a fully developed nation by 2047, the 100th year of independence from British colonial rule.
"Modi will now probably enter in what I call the legacy phase of his prime ministership, driving India forward politically, economically, diplomatically and even militarily," said Bilveer Singh, deputy head, department of political science, at the National University of Singapore.
The idea would be to make the country a "strong regional power that is also a counterbalance to China, but not to serve Western interest as is sometimes alleged, but mainly to promote India's interest, power and place in international politics".
A reduced mandate for Modi's ruling alliance forecloses the possibility of changes to India's secular constitution that opposition groups had warned against. Any such measures require the support of two-thirds of members of parliament.
Concerns have grown in recent years that the BJP's Hindu nationalist agenda has polarised the country with Modi himself turning up the rhetoric, accusing the main opposition Congress of appeasing Muslims for votes.
Yashwant Deshmukh, founder of CVoter polling agency and a political analyst, said the BJP's top goal of introducing common civil laws to replace Islam's sharia-based customs and other religious codes would have to go on the back burner.
"These will have to be debated," he said.