There are 2 separate externalities with different costs:

* CO2 emissions through burning fossil fuel

* plastic garbage with 1000 year lifetimes being littered around the planet

While we should absolutely be addressing both, you have to target these 2 problems separately

Edit: To clarify what I'd propose would be a tax on fossil fuel production, and then an additional, much higher tax on production of things like plastic bags