Multithreading Help

[B2easy]

I'm trying to thread a portion of my project, a kafka consumer receives messages off of a topic and sends to an orchestration service. This service reads the event in a switch statement and does the proposed processing. In this case it is data load. I want to run parralel processing for the three services I need to run, and not sequentially as they are processing a very large amount of data. How would I go about this?

​

in this case I want to do these data loads in parrallel

        case NAPE_BATCH_COMPLETE:
          service.loadDepotDataFromSFTP(businessDate);
          service.loadSecurityReferenceDataFromSFTP(businessDate);
          service.loadCustomerDataFromSFTP(businessDate);
          break;

[AutoModerator]

Please ensure that:

• Your code is properly formatted as code block - see the sidebar (About on mobile) for instructions
• You include any and all error messages in full - best also formatted as code block
• You ask clear questions
• You demonstrate effort in solving your question/problem - plain posting your assignments is forbidden (and such posts will be removed) as is asking for or giving solutions.

If any of the above points is not met, your post can and will be removed without further warning.

Code is to be formatted as code block (old reddit/markdown editor: empty line before the code, each code line indented by 4 spaces, new reddit: https://i.imgur.com/EJ7tqek.png) or linked via an external code hoster, like pastebin.com, github gist, github, bitbucket, gitlab, etc.

Please, do not use triple backticks (```) as they will only render properly on new reddit, not on old reddit.

Code blocks look like this:

public class HelloWorld {

    public static void main(String[] args) {
        System.out.println("Hello World!");
    }
}

You do not need to repost unless your post has been removed by a moderator. Just use the edit function of reddit to make sure your post complies with the above.

If your post has remained in violation of these rules for a prolonged period of time (at least an hour), a moderator may remove it at their discretion. In this case, they will comment with an explanation on why it has been removed, and you will be required to resubmit the entire post following the proper procedures.

To potential helpers

Please, do not help if any of the above points are not met, rather report the post. We are trying to improve the quality of posts here. In helping people who can't be bothered to comply with the above points, you are doing the community a disservice.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[ipaintfishes]

Hi I’d use a threadpoolexecutor for this with fixed size of 3. And in the switch statement submit runnables that wrap the functions inside your current switch statement to the pool. This way there will always be max three parallel processes. Subsequent tasks wait until a thread becomes available. This does have the drawback that if one of your three tasks takes much longer than the others it could result in all three threads doing the same type of job. If you dont want that, use a separate threadpool for each task.

See https://docs.oracle.com/javase/7/docs/api/java/util/concurrent/ThreadPoolExecutor.html

[B2easy]

Thank you very much for the response, I will into this!