sounds like a job for clojure, lazy seqs and java's threading and network libraries make this sort of thing not too terrible