According to Mr Gachagua, mourners, including children, were caught up in the chaos, with many scrambling for safety.
The decision comes hours after Rigathi Gachagua was impeached from office by the Senate on Thursday night even as he took in ill at a Nairobi hospital.
The impeachment follows months of allegations surrounding Gachagua's involvement in corruption and financial misconduct.
This is the culmination of a major fallout between Gachagua and President William Ruto.
The president's allies in parliament have accused Gachagua of undermining the government, promoting ethnically divisive politics, having a role in fuelling the deadly protests that rocked the country in June, and of being involved in corruption.
Mr Gachagua acknowledged the loyalty many in the region still feel toward Mr Kenyatta, expressing regret over the 2022 elections when a significant portion of the Mt Kenya electorate did not heed Mr Kenyatta's advice to back opposition leader Raila Odinga.
