https://delta.io logo
a

Amit Panwar

05/12/2023, 12:07 PM
hi .. i dont want to use databrick , is it possible to use delta with EMR ?
t

Tristen

05/12/2023, 12:21 PM
Have you tried reviewing the AWS docs for it? https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-delta.html
c

Carl Mattsson

05/12/2023, 12:34 PM
Yes, it is possible 👍 you can also install Delta Lake on older versions of EMR that don’t have native support (pre-EMR 6.9.0)
a

Amit Panwar

05/12/2023, 1:00 PM
Copy code
from delta.tables import *
from pyspark.sql.functions import *
In [11]:
Copy code
deltaTable = DeltaTable.forPath(spark, "tmp/delta-table")
In [12]:
Copy code
# Update every even value by adding 100 to it
deltaTable.update(condition=expr("id % 2 == 0"), set={"id": expr("id + 100")})
Copy code
deltaTable.update
this is not working