5

I have a program which is constantly getting information from a website and is constantly updating. As of now I store all that information in an arraylist and then when I am done I write it to a text file.

I need to manipulate that information; however, it creates a massive text file and I can't constantly read and write information to a text file because it takes too long. So someone told me to look into using a database. The only database I have ever used was a MySQL database for a website, never with java.

Is there any way to make a database local? As in only on my computer (don't want to pay for web hosting when I am the only one accessing this information at my computer)? I was looking a little bit into SQLite but one of the things I saw was that it does not allow concurrency. I'm thinking of multi-threading my program and having it read and write different sections at the same time. Is this possible?

Basically what I'm asking for here is:

  1. What type of database should I use?
  2. How do I install that database on my computer?
  3. Some information on how to use Java jdbc?(was reading a little into it before)
  4. Any tutorials on any of the above (video, text, etc)
bobs
  • 21,844
  • 12
  • 67
  • 78
Jon Storm
  • 185
  • 1
  • 3
  • 10
  • If you do not have too many concurrent accesses, IMO you can stay with SQLite, without having a too big impact on performance. Otherwise you should download MySQL and install it as a local service and use it. If you have the time to learn it you can also use an ORM solution like Hibernate or Datanucleus - this will make your data access more abstract & portable (you can switch the storages/backends easily - from excel/xml to mySQL/oracle etc. ). – Matyas Jun 29 '11 at 16:22

4 Answers4

8

It sounds like your friend is correct and a database would greatly help you improve performance.

  1. You can really use any type of database. You can even continue using MySQL by installing it locally and using Connector/J to connect in Java. Though embeddable databases are probably the easiest. One option is Hypersonic DB (HSQLDB)
  2. There is no need to "install" embeddable databases. Simply add their library (.jar file) to your project's build path. When you "connect" to the database, you can usually tell the database to use a location on your filesystem to store its data.
  3. JDBC stands for Java DataBase Connectivity. It is the API used by Java applications to communicate with databases. One of the important features of JDBC is that it (usually) does not matter which database you are talking to as the API for accessing any database is the same*.
  4. Here is one tutorial for JDBC: JDBC(TM) Database Access

*The API for accessing databases--e.g. sending queries and retrieving results--will generally be the same but JDBC can't hide differences in things like SQL. If you use an ORM like Hibernate, it can usually make it much easier to handle all the little incompatibilities between databases.

Jack Edmonds
  • 31,931
  • 18
  • 65
  • 77
  • Im going to start reading up on Hypersonic DB (HSQLDB). Since your the second person to suggest it its got to be good. Thanks for the answer – Jon Storm Jun 29 '11 at 17:09
1

You need embeddable Java database, e.g. HSQL.

Rostislav Matl
  • 4,294
  • 4
  • 29
  • 53
0

What you really need is an embedded Java database, you can find a huge list of those here: Java Embedded Databases Comparison

Community
  • 1
  • 1
leventov
  • 14,760
  • 11
  • 69
  • 98
0

There are various options for embedding an SQL database within your JVM, e.g. Derby.

ewan.chalmers
  • 16,145
  • 43
  • 60