6/19/2023 0 Comments Where is spark sql on macLets you query data using JDBC/ODBC connectors from external business intelligence (BI) data sources such as Tableau, Power BI, Talend, or from RDBMSs such as MySQL and PostgreSQL. Provides the engine upon which the high-level Structured APIs we explored in Chapter 3 are built.Ĭan read and write data in a variety of structured formats (e.g., JSON, Hive tables, Parquet, Avro, ORC, CSV). This chapter and the next also explore how Spark SQL interfaces with some of the external components shown in Figure 4-1. Now, we’ll continue our discussion of the DataFrame and explore its interoperability with Spark SQL. ![]() In particular, we discussed how the Spark SQL engine provides a unified foundation for the high-level DataFrame and Dataset APIs. In the previous chapter, we explained the evolution of and justification for structure in Spark. ![]() Spark SQL and DataFrames: Introduction to Built-in Data Sources
0 Comments
Leave a Reply. |