Right click on taskbar -> properties -> on the "taskbar buttons" select the "combine when taskbar is full" or "never combine".
Thats it. Works well for me.
Kutools for Excel is a powerful add-in that frees you from performing time-consuming operations in Excel, such as combine sheets quickly, merge cells without losing data, paste to only visible cells, count cells by color and so on. 300+ powerful features / functions for Excel 2019, 2016, 2013, 2010, 2007 or Office 365!
It enables tabbed browsing, editing, and managing of Microsoft Office applications. You can open multiple documents / files in a single tabbed window, such as using the browser IE 8/9/10, Firefox, and Google Chrome. It's compatible with Office 2019, 2016, 2013, 2010, 2007, 2003 or Office 365. Demo
Kutools for Outlook is a powerful add-in that frees you from time-consuming operations which majority of Outlook users has to perform daily! It can save your time from using Microsoft Outlook 2019, 2016, 2013, 2010 or Office 365!
Kutools for Word is a powerful add-in that frees you from time-consuming operations which majority of Word users have to perform daily! It can save your time from using Microsoft Word / Office 2019, 2016, 2013, 2010, 2007, 2003 or Office 365!
Restores the old look and menus of Office 2003 to Microsoft Office 2019, 2016, 2013, 2010, 2007 or Office 365. Don’t lose time in finding commands on the new Ribbon. Easy to deploy to all computers in enterprises and organizations.
When you use Excel 2007 and 2010, have you noticed that all of your opened Excel files are only displayed as one window in the taskbar? This will be annoying when you tried to switch among the workbooks, and if you want to close only one file, all of the opened files will be closed at once. So how could you show all Excel windows in the taskbar?
In Excel 2007 and 2010, you need to check an option in the Excel Options to solve this task.
1. Click File > Options in Excel 2010 or click Office button > Excel Options in Excel 2007, in the Excel Options dialog box, click Advanced from the left pane, and then scroll down to Display section, and check Show all windows in the taskbar option, see screenshot:
2. Then click OK to close this dialog, and all the opened workbooks have been displayed in the taskbar, you can switch among them quickly, see screenshots:
Note: In Excel 2013, this Show all windows in the taskbar feature has been removed from the Excel Options.
If you have installed Office Tab in your computer, it helps you view and edit multiple files within a single tabbed window, to know more about Office Tab and want to down load it please click here.
After installing Office Tab, open multiple workbooks, you will see all the workbooks name have been displayed within a single tabbed window as following screenshot shown:
And if you also want to show these windows in the taskbar, please click Office Tab > Options Center, in the Tabs for Excel Options dialog, check Display all windows in the taskbar under General & Position tab, see screenshot: