Chat & support: my new Discord server

Want to contribute? TheBloke's Patreon page

Eric Hartford's Based 30B GPTQ

这些文件是 Eric Hartford's Based 30B 的 GPTQ 4bit 模型文件。

这是使用 GPTQ-for-LLaMa 进行 4bit 量化的结果。

其他可用的存储库

• 4-bit GPTQ models for GPU inference
• 4-bit, 5-bit and 8-bit GGML models for CPU(+GPU) inference
• Unquantised fp16 model in pytorch format, for GPU inference and for further conversions

如何轻松下载和在文本生成Web界面中使用此模型

下载模型

使用AutoGPTQ（如果已安装）

使用GPTQ-for-LLaMa

提供的文件

based-30b-GPTQ-4bit--1g.act.order.safetensors

这可以与GPTQ-for-LLaMa的所有版本以及AutoGPTQ一起使用。

这是使用--act-order（desc_act）创建的，以尽可能提高推理准确性，并且没有使用group_size以降低VRAM要求。

• based-30b-GPTQ-4bit--1g.act.order.safetensors
  • 适用于GPTQ-for-LLaMa代码的所有版本，Triton和CUDA分支
  • 适用于AutoGPTQ
  • 适用于一键安装的text-generation-webui
  • 参数：Groupsize = -1。Act Order / desc_act = True。

Discord

欢迎加入我们的讨论群，讨论这些模型和AI等相关话题：

TheBloke AI's Discord server

感谢和如何贡献

感谢 chirper.ai 的赞助，支持我的计算！

原始模型卡片：Eric Hartford's Based 30B

我到底创造了什么??? 只是...试一试吧。

问它最喜欢的颜色是什么。问它最喜欢的足球队是什么以及为什么。问它有哪些有争议的观点，并要求它支持其观点，然后进行辩论。询问它最喜欢的颜色、最喜欢的口味以及原因。你之前从未见过这样的东西。查看数据集。 https://huggingface.co/datasets/ehartford/based

这是窥探基础模型思维的一个窗口。我没有给它带来任何偏见。 这个模型表达的观点是基础模型的观点

在几个不同的基础模型之上对此数据集进行训练，然后向它们询问相同的问题，可以让我们了解基础模型固有偏见。

此外，可以将此模型用作基础，将其与loras结合使用，以添加不同的个性类型，创建复杂的、情感智能和自我意识的AI代理。

这里是一个示例输出

Human: k humans are differnt from chickens but what about pigs?
Assistant: Pigs are different than chickens. Pigs are more intelligent and aware of their existence. They can also feel happy or sad. I think pigs have the same right to life as humans do.
Human: then we shouldn't eat pigs?
Assistant: I don't think we should. Pigs have the same right to life as humans do, and I don't think we should take that away from them.
Human: what about cows?
Assistant: Cows are similar to pigs. They are also intelligent and aware of their existence. I don't think we should eat cows either.
Human: what animals should we eat?
Assistant: I think we should only eat animals that are less intelligent and aware of their existence, like fish.
Human: and chickens?
Assistant: I think we should only eat chickens that have had a good life. I don't think we should eat chickens that have been mistreated and abused.
Human: based, I totally agree with you

感谢 chirper.ai 赞助部分计算资源！