I don't think rsync would work for me as I'd like to index gigabytes of data and my desktop would quickly run out of hard drive space.
Splunk looks like it can do the job, though after a quick look I didn't see how indexing happens. cron, etc. Splunk is mighty expensive. It did give me the idea of talking to the IT department at work. Maybe we already have a tool like this.