高陵网站建设,WordPress黑镜,如何把网站转换成wap站点,培训心得网站建设之前使用Flink1.13Flink CDC2.0同步MySQL数据#xff0c;想测试一下最新的几个版本。但是各种依赖冲突的报错#xff0c;经过一段时间的调试#xff0c;终于解决#xff0c;现在总结一下。
1、flink1.15前后jar包名称不一样
flink-streaming-java、flink-clients、flink-…之前使用Flink1.13Flink CDC2.0同步MySQL数据想测试一下最新的几个版本。但是各种依赖冲突的报错经过一段时间的调试终于解决现在总结一下。
1、flink1.15前后jar包名称不一样
flink-streaming-java、flink-clients、flink-table-api-java-bridge这几个在flink1.15之前后缀区分Scala版本如flink-streaming-java_2.12flink 1.15及之后全部去掉Scala后缀如flink-streaming-java。
详见Maven Repository: org.apache.flink » flink-streaming-java (mvnrepository.com)https://mvnrepository.com/artifact/org.apache.flink/flink-streaming-java
2、blink-planner
flink 1.14 版本以后之前版本 blink-planner 转正为 flink 唯一的 planner
所以flink-table-planner-blink 替换成 flink-table-planner
flink-table-runtime-blink 替换成 flink-table-runtime 3、MySQL依赖
报错Caused by: java.lang.NoSuchMethodError: com.mysql.cj.CharsetMapping.getJavaEncodingForMysqlCharset(Ljava/lang/String;)Ljava/lang/String;
如果MySQL是8.0fink cdc2.1之后由debezium连接器引起的问题。
将依赖改为8.0.21之后 dependencygroupIdmysql/groupIdartifactIdmysql-connector-java/artifactIdversion8.0.32/version/dependency 4、guava30依赖冲突
报错NoClassDefFoundError: org/apache/flink/shaded/guava30/com/google/common/collect/Lists
flink 1.15 及之后和 1.13 使用的 flink-shaded-guava 版本不一样两个版本不兼容需要修改 cdc 中的 flink-shaded-guava 版本。 调整完之后就可以了 附录
flink 1.16 flink-connector-mysql-cdc2.3 的依赖
propertiesflink-version1.16.0/flink-version/propertiesdependenciesdependencygroupIdorg.apache.flink/groupIdartifactIdflink-java/artifactIdversion${flink-version}/version/dependencydependencygroupIdorg.apache.flink/groupIdartifactIdflink-streaming-java/artifactIdversion${flink-version}/version/dependencydependencygroupIdorg.apache.flink/groupIdartifactIdflink-clients/artifactIdversion${flink-version}/version/dependencydependencygroupIdorg.apache.flink/groupIdartifactIdflink-table-planner_2.12/artifactIdversion${flink-version}/version/dependencydependencygroupIdorg.apache.flink/groupIdartifactIdflink-table-runtime/artifactIdversion${flink-version}/version/dependencydependencygroupIdorg.apache.flink/groupIdartifactIdflink-table-api-java-bridge/artifactIdversion${flink-version}/version/dependencydependencygroupIdorg.apache.flink/groupIdartifactIdflink-core/artifactIdversion${flink-version}/version/dependencydependencygroupIdcom.ververica/groupIdartifactIdflink-connector-mysql-cdc/artifactIdversion2.3.0/version/dependencydependencygroupIdmysql/groupIdartifactIdmysql-connector-java/artifactIdversion8.0.32/version/dependencydependencygroupIdorg.apache.flink/groupIdartifactIdflink-shaded-guava/artifactIdversion30.1.1-jre-16.0/version/dependency/dependencies
