Ahmad Moustafa
Ahmad Moustafa
Programming language:Python
2021-07-17 23:45:40
0
Q:

A distributed collection of data grouped into named columns

Jay
Jay
Code: Python
2021-05-30 15:29:52 
# A distributed collection of data grouped into named columns

people = sqlContext.read.parquet("...")

ageCol = people.age

# To create DataFrame using SQLContext
people = sqlContext.read.parquet("...")
department = sqlContext.read.parquet("...")

people.filter(people.age > 30).join(
  department, people.deptId == department.id).groupBy(
  department.name, "gender").agg({"salary": "avg", "age": "max"})
0

Tags

Related

New to Communities?

Join the community