NullpointerException when running a query and the dataset is not found

[emanuelbatista]

Environment details

1. BigQuery
2. OS type and version: Mate Desktop Environment 1.20.1
3. Java version: Java 8
4. bigquery version(s): 1.16.0

Steps to reproduce

1. Running a query when the dataset is not found

Code example

      QueryJobConfiguration dmlQueryConfig = QueryJobConfiguration.newBuilder(dmlQuery).build();

      // Execute the query.
      TableResult result = bigquery.query(dmlQueryConfig);

Stack trace

Any additional information below

Following these steps guarantees the quickest resolution possible.

Thanks!

[pmakani]

@emanuelbatista I tested many times with different version but not able reproduce that error which you are getting, and also could you please verify bigquery client version ? because you have mentioned above library version which does not exists in maven central.

[emanuelbatista]

@pmakani I have tested to the client 1.61.0. I have seen in the code where the error was thrown and it continues yet to the library's current version in this repository.

[pmakani]

@emanuelbatista you can see below example and errors which i am getting when dataset is not exists. if i am doing wrong in below example, could you please provide an example or correct below example so i can reproduce that error ?

public class QueryExample {
  public static void main(String[] args) throws InterruptedException {
    String dmlQuery = "SELECT * FROM test_dataset_123.insert_rows";
    BigQuery bigQuery = BigQueryOptions.getDefaultInstance().getService();
    QueryJobConfiguration dmlQueryConfig = QueryJobConfiguration.newBuilder(dmlQuery).build();

    // Execute the query.
    TableResult result = bigQuery.query(dmlQueryConfig);
    result.iterateAll().forEach(val -> System.out.println(val));
  }
}

Exception in thread "main" com.google.cloud.bigquery.BigQueryException: Not found: Dataset project-xyz:test_dataset_123 was not found in location US
	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.translate(HttpBigQueryRpc.java:106)
	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.getQueryResults(HttpBigQueryRpc.java:586)
	at com.google.cloud.bigquery.BigQueryImpl$34.call(BigQueryImpl.java:1208)
	at com.google.cloud.bigquery.BigQueryImpl$34.call(BigQueryImpl.java:1203)
	at com.google.api.gax.retrying.DirectRetryingExecutor.submit(DirectRetryingExecutor.java:105)
	at com.google.cloud.RetryHelper.run(RetryHelper.java:76)
	at com.google.cloud.RetryHelper.runWithRetries(RetryHelper.java:50)
	at com.google.cloud.bigquery.BigQueryImpl.getQueryResults(BigQueryImpl.java:1202)
	at com.google.cloud.bigquery.BigQueryImpl.getQueryResults(BigQueryImpl.java:1186)
	at com.google.cloud.bigquery.Job$1.call(Job.java:329)
	at com.google.cloud.bigquery.Job$1.call(Job.java:326)
	at com.google.api.gax.retrying.DirectRetryingExecutor.submit(DirectRetryingExecutor.java:105)
	at com.google.cloud.RetryHelper.run(RetryHelper.java:76)
	at com.google.cloud.RetryHelper.poll(RetryHelper.java:64)
	at com.google.cloud.bigquery.Job.waitForQueryResults(Job.java:325)
	at com.google.cloud.bigquery.Job.getQueryResults(Job.java:291)
	at com.google.cloud.bigquery.BigQueryImpl.query(BigQueryImpl.java:1173)
	at com.qlogic.QueryExample.main(QueryExample.java:15)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
GET https://www.googleapis.com/bigquery/v2/projects/project-xyz/queries/dcaa3caf-e55f-49ad-8e44-c5099fd5a3bc?location=US&maxResults=0
{
  "code" : 404,
  "errors" : [ {
    "domain" : "global",
    "message" : "Not found: Dataset project-xyz:test_dataset_123 was not found in location US",
    "reason" : "notFound"
  } ],
  "message" : "Not found: Dataset project-xyz:test_dataset_123 was not found in location US",
  "status" : "NOT_FOUND"
}
	at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:150)
	at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
	at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:444)
	at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1108)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:542)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:475)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:592)
	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.getQueryResults(HttpBigQueryRpc.java:584)
	... 16 more

[emanuelbatista]

@pmakani exactly the same way you made, but the behavior to running code was different for me.
When I had running, in com.google.cloud.bigquery.Job.getQueryResults(Job.java:291) wasn't thrown exception as you showed

However, in line 301(file com.goole.cloujd.bigquery.Job) , the function job.getStatus().getExecutionErros() is returning null and when it's inputed as null into ImmutableList.copyOf is thrown NullPointException.

Another detail, the job.getError() is getting the same error that you described above.