I believe the filters get pushed to all the forwarders with the app and i cannot choose as to which end points the filter applies.
That is correct. Currently, you cannot have different configurations for different endpoints unless you point those endpoints to a different splunk server running the stream app via the splunk_stream_app_location
parameter in inputs.conf
.