Answer by dkmonet for Read parquet file having mixed data type in a column
The only way that I have found is to manually cast one of the fields so that they match. You can do this by reading in the individual parquet files into a sequence and iteratively modifying them as...
View ArticleRead parquet file having mixed data type in a column
I want to read a parquet file using spark sql in which one column has mixed datatype (string and integer).val sqlContext = new SQLContext(sparkContext)val df = sqlContext.read.parquet("/tmp/data")This...
View Article
More Pages to Explore .....
