There are two options. The first is similar to creating a channel (see above). Here you have to manually select which channel the conversation should be assigned to.
Alternatively, you can create a conversation directly from the channel, for example to start a larger discussion. You can either click on the plus symbol in the bottom right and select "Conversation" or hover over a message, click on the three-dot menu and select "Start a conversation".