Devender Yadav devender-yadav

## pyspark-jdbc-intro.md

      
              3 files
            
          
              0 forks
            
          
                1 comment
              
            
              0 stars
            
          
                devender-yadav
                / pyspark-jdbc-intro.md
            
            
              Last active
              June 19, 2021 04:41
            
              
                Pyspark JDBC samples
              
          
    Fetching data via JDBC using pyspark
https://spark.apache.org/docs/latest/sql-data-sources-jdbc.html
Database used - MySQL

Data used - academia.stackexchange.com.7z from https://archive.org/details/stackexchange
Data from multiple tables are there in academia.stackexchange.com folder. I used PostHistory.xml.

  
## spark_tutorial.md

      
              1 file
            
          
              3 forks
            
          
                0 comments
              
            
              6 stars
            
          
                devender-yadav
                / spark_tutorial.md
            
            
              Last active
              October 10, 2022 10:12
            
              
                Introduction to Spark
              
          
    Spark:sparkles:

Unified analytics engine for large-scale data processing (mostly in-memory).
Table of Content


Main Features
Components
Component Versions