Using Tweetnest with Hashtags part II (The Java Crawler)

Still working on the Crawler, in this section I’m trying to make the crawler tokenize the words and populate table tn_words, which will be later used to create a word cloud, which is what i was looking for in the first place, also i need to populate the table tn_users while i’m at it.

so when the crawler fetches the tweets, and as it is inserting a tweet its going to do the following:

Crawler Flowchart

The crawler flowchart

Tweetnest ERD

Tweetnest ERD

The crawler is complete, all whats left now is testing it with the php GUI and see if its still working, then i’ll start on the GUI modification.


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s