文档 Learning_Spark/5.Spark Streaming/ReadMe.md at master · LeslieZhoa/Learning_Spark # 在pyspark下运行 from pyspark.ml.feature import HashingTF,IDF,Tokenizer # 导入相关包 # 创建一个dataframe,toDF为定义列名 sentenceData = spark.createDataFrame([(0, "I heard about Spark and I love Spark"),(0, "I wish Java could use case classes"),(1, "Logistic regression models are neat")]).toDF("label", "sentence") # Tokenizer作用是分词 tokenizer = Tokenizer(inputCol="sentence", outputCol="words") wordsData =...