You can use your bank's online site to pay your bills and protect yourself from having your check get lost in the mail. Most banks will have a section in which you set up payees. You will need to fill out the information once, and then you can simply choose that profile every time you pay a bill online.
If your bank will not pay bills online, you may consider paying through the company's website. Be careful since some of these companies may charge a convenience fee. Some places will charge a fee for a debit card, but not if you set up a direct debit.
If you access your bank's website on your mobile phone, the bank's app typically allows you to deposit checks with just a snapshot of the document. This means that you can handle all of your banking without ever going to the bank. However, keep your eyes open for any convenience fees associated with online bill pay.