Tag: sqoop

从sql server导入数据的Sqoop作业忽略模式: 如何将模式名称传递给sqoop job将数据从SQL Server导入到hdfs ？ sqoop job –create job_name — import –connect “jdbc:sqlserver://server:port;database=datatabase_name;username=user;password=password” –table source_table –as-avrodatafile –target-dir data/target_folder — –schema schema_name 当我使用执行作业时 sqoop job -exec job_name 生成的查询缺少模式名称。它失败并显示以下错误消息： 15/08/28 10:53:09 INFO manager.SqlManager: Executing SQL statement: **SELECT t.* FROM [source_table] AS t WHERE 1=0** 15/08/28 10:53:09 ERROR manager.SqlManager: Error executing statement: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name ‘source_table’. com.microsoft.sqlserver.jdbc.SQLServerException: […]

如何从Hive Thrift客户端运行Sqoop导入到Hive Thrift服务器？: 使用JDBC我可以轻松连接并能够使用以下示例代码运行Hive-QL查询： – Connection con = DriverManager.getConnection(“jdbc:hive2://192.168.56.102:10000/default”, “”, “”); Statement stmt = con.createStatement(); String tableName = “testHiveDriverTable1”; stmt.executeQuery(“create table ” + tableName + ” (key int, value string)”); 这意味着我能够与Hive进行通信。现在我也想执行sqoop。我该怎么做？我是通过命令行完成的，请参阅以下示例导入 sqoop import –connect jdbc:mysql://192.168.56.101:3316/dw_db –username=user –password=pwd –table active_list –hive-import -m 1 — –schema default 这怎么可能成为现实。并确保运行在10000端口的服务器是Hive thrift Server？如果是，那么如何让它在Hive上执行我的sqoop查询呢？

看起来好像你正在使用JRE运行sqoop – 但JAVA_HOME设置为JDK: 我试图在Ubuntu上设置sqoop（sqoop-1.4.3.bin__hadoop-1.0.0）。我可以毫无问题地运行基本的sqoop帮助等。当我运行以下操作时出现错误： sqoop import –connect jdbc:mysql://localhost/test –table sales -m 1 13/04/19 10:35:24 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/hadoop/hadoop-1.0.4 13/04/19 10:35:24 ERROR orm.CompilationManager: It seems as though you are running sqoop with a JRE. 13/04/19 10:35:24 ERROR orm.CompilationManager: Sqoop requires a JDK that can compile Java code. 13/04/19 10:35:24 ERROR orm.CompilationManager: Please install a JDK and […]