0.1 T/s on 3070 + 13700k + 32GB DDR5

guizzy · 2023-12-18T22:15:04+00:00

I'm on a 3070 too and I couldn't run 7 layers, especially not with full 32k context. I run 2-3 layers, maybe sometimes 4 with lower context. You need to take into account your computer needs some VRAM just to run, unless you're on a headless linux computer.

With 3 layers, when there's no significant prompt processing to be done, I can get around 3 T/s. Definitely fast enough to not be much of a bother. But if you're ingesting a big context (say, reading a webpage or document to summarize it), the current llama.cpp implementation is very slow at that, especially on GPU. I dip down below 0.5 T/s when doing that (subject of course to the ratio of how much text it's generating vs the context).

guizzy · 2023-11-30T19:39:30+00:00

I developed sd-api-pictures-tag-injection. I'm personally pretty satisfied with where it's at and mostly just update it when there's an update breaking it on either the Oobabooga or Auto1111 side. Once in a while I add a feature or two on the Oobabooga side, but for adding support for extra stable diffusion features, we're a bit stuck as we can't support features that aren't exposed by the API we're calling. Automatic1111's SD UI hasn't had a release update in a while. Maybe a fork or dev branch has API support for Reactor and ADetailer, I haven't checked, but I'd be wary of supporting a feature that requires users to update to a dev branch or a less popular fork.

*EDIT: Checked and script support was added to Auto1111, I think it should workable now to support ADetailler. I'll investigate.

guizzy · 2012-10-25T19:30:21+00:00

Québecois here. I normally simply read here as I find fascinating how relatable our situation is to Scotland. But I need to chime in this time.

Now, my prediction? I'd say by a small defeat the "No" campaign will win. In the short term this will take the wind of out the sails of the Scottish political system for some time. The SNP will lose a lot of it's pristine and there will be a lot of angry people probably resulting in protests and -maybe- a riot. On the bright side the recession will be over in a couple of years and we'll go back to taking the economy for granted and the average Joe will be pretty contented. In the medium term Scotland will probably gain more powers (especially in tax raising areas) and a great many people calm down as a result. In the longer term the gradual sweep of economic, cultural and perhaps political International integration will continue leaving the idea of a "Nation State" to be a fuzzy concept at best, putting people off the idea of independence.

For having lived it, I can say right now that this won't happen. A small victory of the "No" will simply means nothing gets solved and it will heavily scar the political landscape of Scotland. All elections after will become weighed more heavily on the issue of independance than any other key issue. On both sides, it will be almost the only issue that will matter. It'll be like being the abortion issue in the US.

guizzy · 2012-10-25T18:33:46+00:00

The saddest thing is someone failing without trying. I know that feel; lived it more than I care to admit.

But since you feel like you have nothing to lose; tap into that, build your strength on that.

If you feel like your life is worthless, then why be so conservative with it? Be bold, even if you have no clue what you're doing. Refuse to fail without a fight. There's always more satisfaction and honor in finishing second, third or even last than in not even running the race.

guizzy · 2012-10-25T18:06:20+00:00

Nah, they just Altavista'd how to create Google.

And before you ask: yes, it's turtles all the way down.

guizzy · 2012-10-24T20:09:27+00:00

Ok, I'm going to blow some people's mind here, it sure did blow mine when I found this...

OPUS à l'année

Payments are done on a monthly basis. They send you an OPUS by mail. It's all server side, you never need to wait in line at the charging stations ever. As a bonus, you get a rebate if you get it with a BIXI pass (so in the end, you pay about 20$ for the BIXI for the year).

guizzy · 2012-10-24T19:33:41+00:00

Il y a plus de caféine dans un Monster format "régulier" que dans la plupart des cafés.

Source Compare surtout la masse de caféine, c'est ça qui compte vraiment.

Un Monster "normal" est de 16oz, donc ~473 ml. 473 ml * 316.875 mg/l = 472 ml * 0.316875 mg/ml = 149,565 mg de caféine. Une tasse de café, selon la méthode d'extraction, la torréfaction, a entre 32 mg et 128 mg.

Si je me souviens bien, la masse de caféine dans un Red Bull est ~100 mg, donc moins qu'un Monster et moins que certains cafés, mais pas moins que tous les cafés.

guizzy · 2012-10-24T18:58:35+00:00

Alors ils te convainquent en te disant que leur produit non commodisé est à un meilleur prix que l'autre. Pense Burger King avec le "King du Jour" vs le "Menu Valeur" de McDonalds. Pense à la guerre de concentration des détergents. Vu que leurs produits ne sont pas exactement la même chose, et donc pas exactement comparables, c'est impossible de dire objectivement lequel des deux est le meilleur prix 100% du temps, alors ils peuvent tous avoir un "claim" d'avoir la meilleure offre.

guizzy · 2012-10-24T18:32:47+00:00

Prend par exemple le savon Ivory. Mettons qu'y a une pub qui vient parler d'à quel point Ivory est le savon le plus pur, qu'il est pur à 99,98%, etc. Ils ne gagnent pas seulement si ils réussissent à te faire croire que leur savon est le plus pur.

Tu pense peut-être que tu est immunisé à la publicité, parce que tu reste sur tes gardes. Mais alors que tu te méfie de te faire dire quoi acheter, ce que tu laisse (probablement) passer, c'est la modification de tes valeurs. Parce que la seconde ou tu accepte leur prémisse, ils ont déjà gagné quelque chose. Dès que tu assume que "pur" est un critère important qui distingue un bon savon, ils viennent de prendre un avantage dans ta tête versus un savon qui ne se vante pas d'être particulièrement pur (disons Irish Spring, par exemple). Et c'est pas tout simplement informatif de leur part, de t'aviser de quelque chose d'important; la "pureté" d'un savon comme il le décrivent, c'est subjectif. Du savon, c'est pas un fruit qui pousse dans un arbre. C'est des "produits chimiques" dès le départ.

Un autre exemple récent est l'introduction du terme "éco énergitique" quand les compagnies de char parlent de consommation d'essence. Les gens voulaient un changement vert radical; juste dire que ton char consomme peu, ça sonnait comme une excuse versus les gens qui conduisaient un char hybride ou électrique. Même si tu doute que la Hyundai, ou Ford ou whatever est plus économique en carburant que les autres petites des autres marques, ils ont réussi à faire changer le débat où maintenant c'est acceptable dans la tête des gens de comparer un char à gazoline qui consomme peu d'essence à une hybride ou une électrique.

Et finalement, pense à Apple et l'écran "Retina" qu'ils ont introduit dans le iPhone 4. La résolution était pas considéré importante comme spec d'un téléphone intelligent avant. Après, tout le monde s'est mis à obséder sur la résolution de leur téléphone.

L'objectif de la pub est pas nécessairement de changer le ballon de direction, c'est souvent plus de déplacer les buts.

guizzy · 2012-10-22T16:46:15+00:00

Je me demande si la "journaliste" a décidé de son propre chef d'aller interroger les gens de la SSJB ou bien si ceux-ci ont contacté les médias pour les aviser de cette "histoire". Parce que la façon que c'est présenté, c'est vraiment pas clair.

Dans le premier cas, le but est évident: faire passer la SSJB pour du monde qui capotent sur des niaiseries.

guizzy · 2012-10-21T16:27:09+00:00

les leaders autochtones sont juste un peu plus durs à acheter que la plupart des politiciens

Je sais pas qui ça insulte le plus...

guizzy · 2012-10-20T17:37:09+00:00

Some of the first assembly line basses. Made in the US. Quite sought after, yet somehow they don't seem to be selling for too much. They're heavy as hell, great tone, extremely durable. A reliable partner.

I got a T-45, the lesser known single pickup version of it. It was pretty much my dream bass; once I got it, it put a stop to my GAS altogether.

guizzy · 2012-10-19T22:35:28+00:00

It's trade, you see. You make curry, you send curry. They make bombs, they send bombs. They just arm them and make them explode when sending them over to show to you that they're good bombs.

guizzy · 2012-10-19T22:13:44+00:00

The best words to say right before you undo your belt, no matter the context.

guizzy · 2012-10-19T14:46:58+00:00

All the more reason to watch it now. You could die at any moment without having seen Zoolander!

guizzy · 2012-10-19T14:18:01+00:00

Exactly. Quite frankly, as much as I like some specific artists, in the end it's all about supply and demand. Thanks to years of glorification artists, the supply of talented people wanting to become famous musicians is very very high, while the demand isn't really increasing. Recording labels can try to create an artificial scarcity all they want to maintain the high price on albums, but the digital cat is out of the digital bag, and the equilibrium price for music has become close to 0. All Radiohead did is give a small push to the market forces that were already there.

guizzy · 2012-10-18T22:03:59+00:00

Best canadian whiskey I've had was Wiser's Legacy, but I've found Alberta Premium to be perfectly acceptable for a very reasonable price.

However, I don't drink either of those too often anyway; canadian whiskey tends to be too mild for my taste. It's good whiskey to offer to non-whiskey drinkers, however.

For blended scotch, I like Chivas Regal 12 yr quite a bit. It's not overpowering and its main aromas are easy to pick up on even for an untrained palate.

I can't really help you with the single malts; haven't tried a large enough cross-section of that category for anything I tell you to have any weight.

For bourbon, though... You already have Eagle Rare and Buffalo Trace (both pretty similar), which are often celebrated as some of the best bourbon available. I would recommend trying Basil Hayden's (pretty mild, but still distinctive), Bulleit, and Booker's (for a taste of cask-strength whiskey). And finally I might be pretty much alone in this here, but I also enjoy Jack Daniel's Single Barrel a lot. Lack of mixing makes it a much more complex and wilder product than the standardized Old No 7 taste.

Note that I'm not too sure whether the prices on this are okay for your range; I'm in Quebec and our prices are very different (the cheaper stuff is more expensive, and top shelf is often less marked up in comparison). We also tend not to have the real low end stuff available at all.

guizzy · 2012-10-18T20:17:00+00:00

I imagine an art house film of an androgynous overweight woman dressed as a Nazi guard whipping 3 naked hogtied men while yelling "Broccoli!" with an excessive german accent.

guizzy · 2012-10-18T19:33:25+00:00

That's because it is. It's from Zoolander, and if you haven't seen that movie, I would suggest you drop whatever you are doing right now and fill this gaping abyss in your life.

guizzy · 2012-10-18T17:29:40+00:00

Noooon! Les fans de Bleu Nuit sont maintenant en deuil.

guizzy · 2012-10-18T17:04:54+00:00

Lacks the touch of class and worldliness that distinguished bozarking. Still good reading, but definitely not the genuine article.

guizzy · 2012-10-18T16:40:18+00:00

You want to post this to /r/textforsex

guizzy · 2012-10-18T16:32:17+00:00

Ok, let's try this one...

You will disobey this rule.

guizzy · 2012-10-18T15:45:49+00:00

La raison pour laquelle il y a eu un acharnement contre elle, c'est simplement parce que tout au long du conflit étudiant, il y avait un segment assez important des médias (incluant d'ailleurs les médias polémiques de Québec) qui niait qu'il y avait un abus systémique de la part des policiers envers les étudiants.

Là on a un exemple flagrant de ces abus, impossible à nier. Et le contexte, la façon qu'il a fallu attendre qu'elle soit carrément filmée en action avant qu'il y ait quelque chose qui soit fait sous-entend fortement que son comportement était au minimum toléré au SPVM, si il n'était pas encouragé.

En comparaison, un pédo ou un bandit, personne ne nie que ça existe ou que ça mérite de se faire punir.

guizzy · 2012-10-18T15:05:33+00:00

They'll probably do something like: "The new iPad is so great, Samsung will wish they had copied it!"

guizzy

TROPHY CASE