Delete the app folder from $SPLUNK_HOME/etc/apps. You will also want to look at indexes and delete any specific indexes that were created for whichever app you are dealing with.
http://docs.splunk.com/Documentation/Splunk/latest/Admin/Managingappobjects#Uninstall_an_app