我有一个python中的SQL查询,它根据时间戳过滤,但是时间戳根据数据帧中的值而变化。
query = """(SELECT [ID],[Timestamp],[Value] FROM [table] Where [Timestamp] >= '2021-10-13') alias"""
big_df = spark.read.format("jdbc").option("driver", driver).option("url", url).option("dbtable", query).load()
print(somedf.Timestamp.min())
'2021-01-01'
query = """(SELECT [ID],[Timestamp],[Value] FROM [table] Where [Timestamp] >= somedf.Timestamp.min()) alias"""
很明显,顶线行不通