Java read large text file with separator

Question

I'm trying to read a large text file in the form of:

datadfqsjmqfqs+dataqfsdqjsdgjheqf+qsdfklmhvqziolkdsfnqsdfmqdsnfqsdf+qsjfqsdfmsqdjkgfqdsfqdfsqdfqdfssdqdsfqdfsqdsfqdfsqdfs+qsfddkmgqjshfdfhsqdflmlkqsdfqdqdf+

I want to read this string in the text file as one big java String. Is this possible? I know the use of the split method.

It worked to read it line by line, but what I really need is to split this long text-string at the '+' sign. Afterwards I want to store it as an array, arraylist, list,...

Can anyone help me with this? Because every information on the internet is just about reading a file line by line. Thanks in advance!

here is the answer for your question: http://stackoverflow.com/questions/3481828/how-to-split-a-string-in-java — m.cekiera, Apr 28 '15 at 13:36

score 3 · Answer 1 · answered Apr 28 '15 at 13:36

3

String inpStr = "datadfqsjmqfqs+dataqfsdqjsdgjheqf+qsdfklmhvqziolkdsfnqsdfmqdsnfqsdf+qsjfqsdfmsqdjkgfqdsfqdfsqdfqdfssdqdsfqdfsqdsfqdfsqdfs+qsfddkmgqjshfdfhsqdflmlkqsdfqdqdf+";

String[] inpStrArr = inpStr.split("+");

Hope this is what you need.

answered Apr 28 '15 at 13:36

Saurabh Jhunjhunwala

2,832
3
29
57

Okay, but how is it possible to read the string then? I think there will be an overflow – arnoutvh Apr 28 '15 at 13:41
iterate the loop and extract each element from the array. for (int i = 0; i < inpStrArr .length; i++) { String str = inpStrArr [i]; System.out.println(str); } – Saurabh Jhunjhunwala Apr 28 '15 at 13:43
It'd be `inpStr.split("\\+")` – Saravana Apr 28 '15 at 13:44
No, what I mean is: how can I read the huge string from my .txt file to a java String? – arnoutvh Apr 28 '15 at 13:45

score 2 · Answer 2 · answered Apr 28 '15 at 13:47

It seems to me like your problem is that you don't want to read the file line by line. So instead, try reading it in parts (say 20 characters each time and building your string):

char[] c = new char[20]; //best to save 20 as a final static somewhere

ArrayList<String> strings = new ArrayList<String>();
StringBuilder sb = new StringBuilder();

BufferedReader br = new BufferedReader(new FileReader(filename));

while (br.read(c) == 20) {

    String str = new String(c);

    if (str.contains("+") {

        String[] parts = str.split("\\+");
        sb.append(parts[0]);
        strings.add(sb.toString());

        //init new StringBuilder:
        sb = new StringBuilder();
        sb.add(parts[1]);

    } else {
        sb.append(str);
    }
}

score 2 · Accepted Answer · answered Apr 28 '15 at 13:53

You can read file using BufferedReader or any IO-classes.suppose you have that String in testing.txt file then by reading each line from file you can split it by separator (+). and iterate over array and print.

BufferedReader br = null;
    try {
        String sCurrentLine;
        br = new BufferedReader(new FileReader("C:\\testing.txt"));//file name with path
        while ((sCurrentLine = br.readLine()) != null) {
               String[] strArr = sCurrentLine.split("\\+");
               for(String str:strArr){
                    System.out.println(str);
                      }
            }

        } catch (IOException e) {
            e.printStackTrace();
        } finally {
            try {
                if (br != null)br.close();
            } catch (IOException ex) {
                ex.printStackTrace();
            }
        }

score 2 · Answer 4 · edited May 23 '17 at 12:07

2

You should be able to get a String of length Integer.MAX_VALUE (always 2147483647 (231 - 1) by the Java specification, the maximum size of an array, which the String class uses for internal storage) or half your maximum heap size (since each character is two bytes), whichever is smaller

How many characters can a Java String have?

edited May 23 '17 at 12:07

Community

1
1

answered Apr 28 '15 at 13:57

Archana Mundaye

523
1
5
19

score 0 · Answer 5 · answered Apr 28 '15 at 14:09

Try this one:

private static void readLongString(File file){
    ArrayList<String> list = new ArrayList<String>();
    StringBuilder builder = new StringBuilder();
    int r;
    try{
        InputStream in = new FileInputStream(file);
        Reader reader = new InputStreamReader(in);
            while ((r = reader.read()) != -1) {
                if(r=='+'){
                    list.add(builder.toString());
                    builder = new StringBuilder();
                }
                builder.append(r);
            }
    }catch (IOException ex){
        ex.printStackTrace();
    }
    for(String a: list){
        System.out.println(a);
    }
}

score 0 · Answer 6 · answered Apr 28 '15 at 14:11

Here is one way, caveat being you can't load more than the max int size (roughly one GB)

  FileReader fr=null;
  try {
      File f=new File("your_file_path");
      fr=new FileReader(f);
      char[] chars=new char[(int)f.length()];
      fr.read(chars);
      String s=new String(chars);
      //parse your string here
  } catch (Exception e) {
      e.printStackTrace();
  }finally {
      if(fr!=null){
          try {
              fr.close();
          } catch (IOException e) {

          }
      }
  }

Java read large text file with separator

6 Answers6

Linked

Related