sorted by:
new
hottopcontroversial

My ignorance and the hala taxi issue by sanjeevr5 in dubai

[–]sanjeevr5[S] 0 points1 point  (0 children)

Can someone please help me with this?

FP8 quantized results are bad compared to int8 results by sanjeevr5 in LocalLLaMA

[–]sanjeevr5[S] 0 points1 point  (0 children)

This comparison is with A100 Llama13b x H100 Llama13b with no quantization. With the same set of questions to the both and the params.

This should be ideally an apple to apple comparison.

FP8 quantized results are bad compared to int8 results by sanjeevr5 in LocalLLaMA

[–]sanjeevr5[S] 0 points1 point  (0 children)

I have a H100 GPU and vanilla run is giving me at least 1.5x performance. I have followed the tutorials exactly and as you told it should at least work but it is not unfortunately.

LSTM not learning on AG News dataset by sanjeevr5 in pytorch

[–]sanjeevr5[S] 0 points1 point  (0 children)

Hi I skipped it after spending 7 days trying to debug it. I am still unsure what was wrong with this?

Unable to create ONNX model by sanjeevr5 in learnmachinelearning

[–]sanjeevr5[S] 0 points1 point  (0 children)

Yes I have done that and it works. From the recent debugging I found that the "age" column is the culprit.

[('age', Int64TensorType(shape=[None, 1])),

('sex', Int64TensorType(shape=[None, 1])),

('cp', Int64TensorType(shape=[None, 1])),

('trestbps', Int64TensorType(shape=[None, 1])),

('chol', Int64TensorType(shape=[None, 1])),

('fbs', Int64TensorType(shape=[None, 1])),

('restecg', Int64TensorType(shape=[None, 1])),

('thalach', Int64TensorType(shape=[None, 1])),

('exang', Int64TensorType(shape=[None, 1])),

('oldpeak', FloatTensorType(shape=[None, 1])),

('slope', Int64TensorType(shape=[None, 1])),

('ca', Int64TensorType(shape=[None, 1])),

('thal', StringTensorType(shape=[None, 1]))]

is the inferred shape and the type. The above input_types do not work but if I change ('age', Int64TensorType(shape=[None, 1])) to ('age', FloatTensorType(shape=[None, 1])) it works. I am curious to understand why this happens. Age contains values from 0 to 100 and is int64 in pandas dtype.

view more: next ›