No. You do not need to download anything to join a conference. Simply follow the directions given to you in the meeting invite provided by the organizer of the conference. 

There is a simple add-on that you will be prompted to download on your first visit. Although not a necessity to enter the web conference, downloading this add-on will enable you to share your desktop if the organizer wishes to make you a presenter at any point during the conference.