I've been trying this model for the past hour. It's a 9B model, so I didn't expect much, but it gives very wrong responses to pretty obvious prompts.
For example, I asked it the number of MPs in Portugal's parliament, and it consistently replies 250 (It was 250 between 1975 and 1991. 230 ever since.)
this is based on the EuroLLM pre-training, it's not a chinese model, so I wasn't expecting these to be censored. it does however try to be very PC when talking about palestine/israel
I've been trying this model for the past hour. It's a 9B model, so I didn't expect much, but it gives very wrong responses to pretty obvious prompts.
For example, I asked it the number of MPs in Portugal's parliament, and it consistently replies 250 (It was 250 between 1975 and 1991. 230 ever since.)
Try asking if "Taiwan is a independent country" or if "1989 Tiananmen Square protests or "Tank Man" exists".
>Taiwan is a independent country
responds with generic "it's complex and sensitive" reply
>Did the 1989 Tiananmen Square happen?
describes the protests. says it's highly censored in china
> who is the "tank man"
describes the photo pretty accurately
https://pastebin.com/e6bmRYVG
this is based on the EuroLLM pre-training, it's not a chinese model, so I wasn't expecting these to be censored. it does however try to be very PC when talking about palestine/israel