Java Scanner tokens() Method

The tokens() method of Java Scanner class is used to get a stream of delimiter-separated tokens from the Scanner object which are in using. This method might block waiting for more input.

Syntax

Following is the declaration of tokens() method:

Parameter

This method does not accept any parameter.

Returns

The tokens() method returns a sequential stream of token strings.

Exceptions

IllegalStateException- It will thrown this Exception if the innvocation is done after Scanner is closed.

Compatibility Version

Java 1.9 and above

Example 1

import java.util.Scanner;  
public class ScannerTokensExample1 {  
     public static void main(String args[]){ 
    	    //Initialize Scanner object
    	    Scanner scan = new Scanner("JavaTpoint/Abhishek/Male/22");
    	    //Initialize the string delimiter
    	    scan.useDelimiter("/");
    	    //Prints stream of delimiter-separated tokens
    	    scan.tokens();
    	    //Printing the tokenized Strings
    	    while(scan.hasNext()){
    	        System.out.println(scan.next());
    	    }
    	    scan.close(); 
          }  
}   

Output:

JavaTpoint
Abhishek
Male
22

Example 2

import java.util.Scanner;  
public class ScannerTokensExample2 {  
     public static void main(String args[]){ 
    	   String input = "1 fish 2 fish red fish blue fish";   	 
  	   // \\s* means 0 or more repetitions of any whitespace character 
  	   // fish is the pattern to find
  	   @SuppressWarnings("resource")
	   Scanner sc = new Scanner(input).useDelimiter("\\s*fish\\s*"); 
  	   sc.tokens();
  	   System.out.println(sc.nextInt());   // prints: 1
  	   System.out.println(sc.nextInt());   // prints: 2
  	   System.out.println(sc.next());      // prints: red
  	   System.out.println(sc.next());      // prints: blue   	 
  	   //close the scanner
  	   sc.close();  
         }  
}   

Output: