Sahih Muslim 1332
Sahih Muslim · Book 15: The Book of Pilgrimage · It is recommended for pilgrims and others to enter the Ka'bah and pray therein, and supplicate in all its corners
Isma'il b. Abu Khalid reported:
وَحَدَّثَنِي سُرَيْجُ بْنُ يُونُسَ ، حَدَّثَنِي هُشَيْمٌ ، أَخْبَرَنَا إِسْمَاعِيلُ بْنُ أَبِي خَالِدٍ ، قَالَ قُلْتُ لِعَبْدِ اللَّهِ بْنِ أَبِي أَوْفَى صَاحِبِ رَسُولِ اللَّهِ صلى الله عليه وسلم أَدَخَلَ النَّبِيُّ صلى الله عليه وسلم الْبَيْتَ فِي عُمْرَتِهِ قَالَ لاَ .
I asked Abdullah b. Abu Aufa (Allah be pleased with him), a Companion of Allah's Messenger (ﷺ), whether Allah's Apostle (ﷺ) had entered the House, while performing 'Umra, He said: NO.