topic Re: Notebook query to get rows from a parquet file and file creation time in Administrative Discussions

Notebook query to get rows from a parquet file and file creation time

RADSr — Mon, 24 Apr 2023 18:27:47 GMT

Incorta cloud so I don't have direct access to Incorta table parquet files. I would like to write queries:

1) to get me the names of the parquet files

2) to get the file creation date

3) to query individual rows w/ filter criteria ( e.g. where ISITFRIDAYYET = 1 )

So obviously step 1 is step 1 -- anyone think this is ridiculously simple *and* want to educate me? I will gladly pay the princely sum of 1 Incorta Community Kudo for the answer! 😉

Re: Notebook query to get rows from a parquet file and file creation time

amit_kothari — Mon, 24 Apr 2023 19:36:22 GMT

Hi RADSr - Please check the attached pdf

Re: Notebook query to get rows from a parquet file and file creation time

RADSr — Mon, 24 Apr 2023 20:55:28 GMT

Thank you!

I think that gets me part way there - I need to know the path on the Incorta cloud server and file naming convention ( or a query to give me the names of all the files in a directory ).

I'm trying /home/incorta/<hostname without.cloud2.incorta.com>/tenants/<tenantname>/parquet/<tablename>/<tablename>/ < don't know >

which a few different guesses at <don't know> but candidly I don't know if any of the path is correct in the Incorta cloud environment.