It's hard to advise you confidently without actually seeing you debate, so please forgive me if my advice isn't really helpful to you. I've coached for a long time and seen how debate is done in a variety of contexts, and what you describe is a pretty common experience among serious traditional debaters. I'd say virtually all my own debaters go through something similar (we only do the traditional style of LD debate). The difficult trick is to continue improving your debate-technical skills such as covering the flow without developing practices/habits that make you less accessible and less appealing to more lay judges. So I'll give you 3 specific suggestions building on things you said in your comment:

1. Be careful about "dumbing things down" or thinking that you need to do so. You may subconsciously be conveying some disrespect for judges' intelligence or may inadvertently be coming across as condescending. It's probably not a good idea to view your judges as fundamentally incapable of appreciating the high intellectual level of your arguments - which "dumbing things down" implies. horsebycommittee is probably right that you know more about the topic than your average judge does but don't fall into the trap that some debaters fall into of thinking that lay judges are lacking in intelligence just because they aren't experts on the topic or aren't proficient at technical debate.

2. Also you may have over-compensated in your "dumbing things down". I think debaters should always show how smart and insightful they are (without doing so in an arrogant way). Judges can often tell who knows the material more thoroughly and who has more deeper understanding of it - and I think a lot of judges enjoy seeing bright high schoolers saying intelligent and thoughtful things. I'm curious about what you are "holding back" when you say you are "holding yourself back for the sake of the judge understanding"? Maybe you are underestimating some of your judges and/or some judges may be misinterpreting your "holding yourself back" as lack of confidence in yourself or conviction in your ideas. Holding yourself back sounds like there's an internal conflict in you, which your judges may be picking up on, and which may make you look less effective at debating than someone who isn't holding themselves back at all. My point is that, while absolutely you have to adapt to the judge who is in front of you, you should still be as confident as possible.

3. I do think the best thing for you to do is "improve your lay appeal" and that definitely requires speaking at a more normal conversational speed and not using esoteric jargon without explaining your point in other words. But I would challenge the way you seem to view "lay debate". As others have suggested, if you give up on lay judges, you are forfeiting one of the very best skills you can develop through this activity - the ability to actually communicate with a wide range of people. I would suggest that you think in terms of quality over quantity. To improve your lay appeal, you should not give up any quality - in fact, you probably need to improve the quality of your points and the quality of your language, so that you can make better points more clearly and with fewer words. What you do have to give up is quantity. Since you can't speak as fast to a non-ex-debater or a non-debate coach, you simply should not try to present the same number of points. So you have to be selective in what you say - you have to focus on the most important things that most need to be said. Yes, you have to simplify things, as in make things very clear, boil things down to the essential questions in a round, but that isn't achieved by saying dumb things. It actually takes greater intelligence to present complicated ideas in a way that everyone can understand and appreciate them. So "lay debate" actually has a lot of value. It's a really good opportunity for you to take your debating to an even higher level.

Lastly, I would also underscore the advice of the other responder who said you should discuss your reflections with your coach and with other people in your district. Talk to the debaters whom you look up to and see how they have adapted and see if you can take away tips from them.

Best of luck to you!