Using Tweetnest with Hashtags part II (The Java Crawler)

Still working on the Crawler, in this section I’m trying to make the crawler tokenize the words and populate table tn_words, which will be later used to create a word cloud, which is what i was looking for in the first place, also i need to populate the table tn_users while i’m at it.

so when the crawler fetches the tweets, and as it is inserting a tweet its going to do the following:

Crawler Flowchart

The crawler flowchart

Tweetnest ERD

Tweetnest ERD

The crawler is complete, all whats left now is testing it with the php GUI and see if its still working, then i’ll start on the GUI modification.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s