Hello,

You can configure that in the Categories Widget.

Go to Appearance > Widgets and locate the Categories Widget in the Right Sidebar.