DilTeam DilTeam - 1 year ago 481
Scala Question

Spark sql (1.4) : Get current timestamp

I know there's a 'current_timestamp' function in Spark 1.5 & above, but we're still on 1.4. How do I add a column to a DataFrame that is set to 'current timestamp'?

df.withColumn("date_inserted", ????)

Answer Source

Simple timestamp literal should do the trick:

Recommended from our users: Dynamic Network Monitoring from WhatsUp Gold from IPSwitch. Free Download