java 如何使用 spring-batch 和 MultiResourceItemReader 读取文件夹中的所有文件?

声明:本页面是StackOverFlow热门问题的中英对照翻译,遵循CC BY-SA 4.0协议,如果您需要使用它,必须同样遵循CC BY-SA许可,注明原文地址和作者信息,同时你必须将它归于原作者(不是我):StackOverFlow 原文地址: http://stackoverflow.com/questions/31700520/
Warning: these are provided under cc-by-sa 4.0 license. You are free to use/share it, But you must attribute it to the original authors (not me): StackOverFlow

提示:将鼠标放在中文语句上可以显示对应的英文。显示中英文
时间:2020-11-02 19:00:51  来源:igfitidea点击:

How to read all files in a folder with spring-batch and MultiResourceItemReader?

javaspringfiledirectoryspring-batch

提问by membersound

I want to configure spring-batchto read all csvfiles inside a specific folder sequentially.

我想配置spring-batchcsv按顺序读取特定文件夹中的所有文件。

The following does not work because the delegate will try to open a file named *.csv, which of course is invalid. What do I have to change here?

以下不起作用,因为委托将尝试打开名为 的文件*.csv,这当然是无效的。我在这里需要改变什么?

    @Bean
    public ItemReader<String> reader() {
        MultiResourceItemReader<String> reader = new MultiResourceItemReader<>();
        reader.setResources(new Resource[] {new FileSystemResource("/myfolder/*.csv")});
        reader.setDelegate(new FlatFileItemReader<>(..));
        return reader;
}

The equivalent xml configuration would be written as follows, how could I rewrite it to java only config?

等效的 xml 配置将写成如下,我如何将其重写为 java only config?

<bean id="reader" class="org.springframework.batch.item.file.MultiResourceItemReader">
        <property name="resources" value="/mypfolder/*.csv"/>
        <property name="delegate" ref="flatFileItemReader"/>
</bean>

采纳答案by Luca Basso Ricci

I think you should use a PathMatchingResourcePatternResolver.

我认为你应该使用PathMatchingResourcePatternResolver.

回答by Tharindu Jayasuriya

Use PathMatchingResourcePatternResolver like this.

像这样使用 PathMatchingResourcePatternResolver。

@Bean
public ItemReader<String> reader() {
    Resource[] resources = null;
    ResourcePatternResolver patternResolver = new PathMatchingResourcePatternResolver();   
    try {
        resources = patternResolver.getResources("/myfolder/*.csv");
    } catch (IOException e) {
        e.printStackTrace();
    }
    MultiResourceItemReader<String> reader = new MultiResourceItemReader<>();
    reader.setResources(resources);
    reader.setDelegate(new FlatFileItemReader<>(..));
    return reader;

}

}

回答by Ihar Zhavarankau

Alternatively @Value annotation can be used to let ResourceArrayPropertyEditor convert string to Resource[].

或者,@Value 注释可用于让 ResourceArrayPropertyEditor 将字符串转换为 Resource[]。

@Bean
@StepScope
public ItemReader<String> reader(
        @Value("file:/myfolder/*.csv") Resource[] resources
) {
    MultiResourceItemReader<String> reader = new MultiResourceItemReader<>();
    reader.setResources(resources);
    reader.setDelegate(new FlatFileItemReader<>(..));
    return reader;
}

回答by Niraj Sonawane

Read multiple files from Absolute file path:

绝对文件路径读取多个文件:

 @Bean
      public MultiResourceItemReader<POJO> multiResourceItemReader() {
        MultiResourceItemReader<POJO> resourceItemReader = new MultiResourceItemReader<POJO>();
            ClassLoader cl = this.getClass().getClassLoader();
            ResourcePatternResolver resolver = new PathMatchingResourcePatternResolver(cl);

        Resource[] resources = resolver.getResources("file:" + filePath );
        resourceItemReader.setResources(resources);
        resourceItemReader.setDelegate(reader());
        return resourceItemReader;
      }

      @Bean
      public FlatFileItemReader<POJO> reader() {
        FlatFileItemReader<POJO> reader = new FlatFileItemReader<POJO>();
        reader.setLineMapper(new DefaultLineMapper() {{
          setLineTokenizer(new DelimitedLineTokenizer() {{
            setNames(new String[]{"id1", "POJO"});
          }});
          setFieldSetMapper(new BeanWrapperFieldSetMapper<POJO>() {{
            setTargetType(POJO.class);
          }});
        }});
        return reader;
      }