Hello,
You can configure that in the Categories Widget.
Go to Appearance > Widgets and locate the Categories Widget in the Right Sidebar.