Starlings are an aggressive invasive species that displace our native cavity nesters such as red-headed woodpeckers.
Have you checked All Seasons Wild Bird Store for upside down feeders? I buy most of my feeders and seed at the Bloomington store. You can also check online at duncraft.com or bestnest.com for all kinds of feeders. I got a caged peanut feeder from Duncraft that allows chickadees and nuthatches in but excludes larger birds. You can feed in-shell peanuts to blue jays, I've never seen starlings go after those.
Also have you tried putting out safflower? All Seasons has a mix called Bye Bye Starling that you might try.