On the table of contents notebooks have the word ‘All’ in the dropdown when filtering but the section list does not for user-created sections.
Luckily users can add this manually themselves:
Go to Tools|Options
Select Notebook Layout
Find the notebook you want and click on it
Above (Add Section) enter All and then press ADD ITEM
All should now appear in the table of contents and should work correctly – i.e., showing every page in the current notebook.