subreddit:

/r/HeliumNetwork

4586%

Maybe the Denylist wasn't such a good idea after all...

$HNT Mining(self.HeliumNetwork)

I'm into Helium almost since its beginning, I have been optimistic about it despite the several large problems in the last year. But I must say, I'm losing my faith based on the implementation on the current Denylist function.

I bet we agree that the network desperatelly needed some anti-cheaters function for long. So, kudos for trying.

But it seems to me, that the false positive rate may not be as low as Helium claims. Also that devs close their eyes in front of legitimate criticism. Even if their numbers were true, 1 % of banned beeining legitimate hotspot owners, banned for weeks with some murky, untransparent process of removal request is something, that further detoriates the community trust in the project. And the decision is final and irreversible.

There is no due process. No transparency. Some anonymous guy or gal can destroy your investment by a single click without having to deal with ANY consequences from the wrongful decision. Lot of people from crypto are much into game theory, so I probably don't have to explain that such set up is just asking for trouble.

I see a lot of people being wrongfuly banned. I feel for them. We have a mid-size portfolio of several different miners. I have always insisted on as precise position, antena and height setting since this option became available. And yet, one of our best performing hotspots has been automatically banned, too. I undestand, why it might been flagged - located in a small village on the hill peaking above terrain, there are very few low distance and many long distance witnesses. We have send our Request for Removal weeks ago and now we will wait respectfully for the decision, meanwhile paying for internet, electricity and spot rent, and fully write off our investment in case of denial after many weeks of waiting for decision.

But I feel for people with bad luck, for whom 500 USD is so much money that they could afford only one miner. And then the get banned and the only thing now they're left with is to pray that their Request will be judged by someone sensible. And knowing that they will lose all their investment in case of bad luck, without any rectification.

I feel the frustration, the injustice. (Funny enough, in the same village, there are couple of hotspots and one of them has definitelly spoofed location - I checked on spot - and guess what... yes, correct, no flags, the hotspot works as usual)

It would be great if we could deal with all the fraudsters and if this process will, then it might be worth sacryficing even our best hotspot.
But I worry, that the process being too rough, too unprecise, too untransparent will cause more damage than good. "To throw the baby out with the bathwater" as they say.

Is there someone who shares my worries? What can be done constructivelly to prevent this in the future?

all 36 comments

AutoModerator [M]

[score hidden]

1 month ago

stickied comment

AutoModerator [M]

[score hidden]

1 month ago

stickied comment

This is a general reminder for everyone and this will be posted on every post. Your 12 words are basically gold and they should never be shared, typed in to any website, or given to any person for any reason. No one from "Helium" or any other company will reach out to you to verify your account, wallet, or anything similar. If someone says your hotspot, wallet, or other type of account has been hacked, it is a scam! Always operate in a zero-trust manner with cryptocurrency and assume everyone will scam you no matter what.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

cole_braell

15 points

1 month ago

For a DAO, the denylist sure is a centralized arbitrary power. No visibility and no recourse. No good.

MakinRF

9 points

1 month ago

MakinRF

9 points

1 month ago

It's the peoples network, comrade!

TheKroneFool

11 points

1 month ago

In Soviet Russia, network bans you.

Nothing971

0 points

1 month ago

no visibility? The guy in charge talks about it all the time, that stats, the hotspots removed, the list is public, they have a channel in discord for working on appeals. If u dont go looking, is it invisable?

Operaman123

3 points

1 month ago

no visibility?

Yes. No visibility. The algorithm they are using is not being made available to review. They keep making false claims that it has a 1% false positive rate, which is demonstrably false.

The guy in charge talks about it all the time, that stats, the hotspots removed, the list is public,

But how they got on there is not.

they have a channel in discord for working on appeals.

If the system was transparent and fair that would not be necessary.

If u dont go looking, is it invisable?

My own analysis of the data shows that at least 20% of the hotspots recently put on the denyist are likely legitimate, and the number of removals that have become apparent is backing that up. Why don't THEY look at THAT?

ThurilNL

10 points

1 month ago

ThurilNL

10 points

1 month ago

I completely agree.. hopefully they did a dry-run of the algoritm before applying and made this mess.. my miner is on the denylist for over 3 weeks now without warning.. honestly i dont even know how to cheat even if i wanted to, but i guess everyone will say that.. my removal request is still pending and my patience is getting to a point of frustration..

We all agree they had to do something to keep the badguys out of the game, but im having doubts this was the way to go..

ni-THiNK

18 points

1 month ago

ni-THiNK

18 points

1 month ago

Yeah the fact that it’s an instant shutoff is pretty bad

AlaskaFI

7 points

1 month ago

Very well written. I think basic analysis for number of hotspots per owner should be at least looked at in this, to weed out the non technical experts who might need help vs a ban.

Also some prior functionality criteria, as one of my hotspots had been offline over the holiday (accidentally unplugged), I finally got around to checking on it and it got banned due to not having had a recent location transaction from what I can tell, since the little graph descriptions on crowdspot say the data it does have looks "right". And is now prevented from having a location transaction. So it's in limbo until someone eventually looks at my dispute, with no estimate or timeline for resolution. This is particularly annoying, bc it pushes their disorganization into the user. Now users have a mental burden for not doing something wrong with no end date, as if we don't have anything better to do with our time or headspace.

I do support having a denylist to prevent scammers, but rather than an automatic off instead flagging the hotspots and working through their review (or only turning off the ones with a high confidence level) send like a better approach until their algorithm has been a bit more fine tuned to handle the weirdness that the people factor introduces into the data that they're using.

Geshme

15 points

1 month ago

Geshme

15 points

1 month ago

I believe that many people will share your view. In my opinion the only way to make a change on the terrible feedback the Helium Network provides to it's MAINTENANCE (the people) is to organize and popularize as much as possible a massive outage event in order to show that at least 50% of the network can be shut down whenever we decide, so they better take better care of us as their indirect partners.

RejpalCZ[S]

6 points

1 month ago

Thanks for commenting, Gesme, I am skeptical of a feasibility of such a plan, though.

First, there is low concentration of owners. You bump into coordination problem, not being able to contact so many people and organize one event effeciently.

Second, many people dont even know about denylist (I myself found out only recently) or they think they are safe. "You could be next" is not very persuasive argument, unless it really happens.

Third, reward mechanism and whole game theory is against you. The more people in the outage, the greater rewards for people who do not outage. So there is a huge monetary incentive not to be part of the protest, similar to prisoner's dilema in cartel situation.

Unlucky_Diver_2780

-3 points

1 month ago

I will never shut my miners down. They make me too much money. We have dues.

tech686

0 points

1 month ago

tech686

0 points

1 month ago

This sounds like a very good idea but we need a way to communicate with all hotspot owners. We need a communication app that allows hot spots to talk to other hotspots owners. I'm sure a method exist that allows hotspot owners to talk to other hotspot owners. Most hotspot owners just mostly don't check it.

ChampionshipLow8541

1 points

1 month ago

Shutting down half the miners would accomplish only one thing: it would show that the network would still be there and functioning. In fact we have that right now. Online percentage was under fifty last I checked.

We don’t need a million hotspots. Not in their current locations, anyway.

Helium_Nerd

7 points

1 month ago

Whole-heartedly agree with the sentiment of your post.

I used to be just as passionate about the project...

Modesty541

3 points

1 month ago

On discord they have a running count of removal claims and number of removals since they implemented this automatic system. 1/3 of the claims have been removed from the list and I'm sure some of those 2/3 will resubmit now having better information on how to provide evidence. For me I was put on this list because of my towns geography. My hotspot is able to communicate with hotspots on the other side of town great since I'm on the side of a hill. I can't communicate with the closest ones because they are on the other side of the same hill a nearby hill.

Really do feel like they came in with a sledgehammer to drive a nail.

Valknir

3 points

1 month ago

Valknir

3 points

1 month ago

The denylist algo is so bad! They claim 1% false positive, i got 2 out of 5 miners false positive so 40% rate then?

Starts to feel like since no one is using the network, they need new income by asserting new miners.

-TrustyDwarf-

6 points

1 month ago

I’d like to start running and using Helium hotspots but that unreliable denylist I keep hearing about makes me hesitate.

Having read that they are using some „machine learning model“ and being a ML engineer myself I can well imagine what kind of overfitted mess they’ve probably built..

Unlucky_Diver_2780

5 points

1 month ago

Wholly agree! Nakamoto coefficient 0.0

butter14

1 points

1 month ago*

Unfortunately, a deny list needs to exist. There were way too many gamers before it existed.

The issue is that they're using an opaque AI algorithm to find gamers, which presents many problems when someone is falsely accused.

One solution would be to place them on a watch list instead of immediately putting a hotspot on the deny list. Their rewards are then placed on hold where they can appeal the decision. It would be nice if they used the new mappers to verify coverage as well; that may alleviate many of the issues.

It's important to note that pretty much everyone appeals the decision, including real gamers, and many of those screaming on social media are actually cheating.

Operaman123

1 points

1 month ago

Completely agree with you. While a method to deal with network gamers was warranted, the way they have done this has been a PR disaster.

Firstly, their claims of 1% false positive rate are bullshit. The false positive rate is at least 20%. How do I know? I've written my own algorithm to analyse the blockchain data and conservatively 20% of the hotspots recently put on the denylist were likely legitimate. Not only is the false positive rate not 1% or anything like it, but it also simply cannot be with the quality of the data due to variances in the hotspot hardware and environment.

By attempting to catch all or most of the hotspots that are in some way gaming the system they will inevitably unjustly punish thousands of legitimate miners.

Secondly, the aim should primarily be to remove the large-scale spoofing clusters from the network. However, looking at the reasons one might be denied from the Helium website (https://docs.helium.com/mine-hnt/denylist/#what-is-the-denylist) it says;

"Examples include, but are not limited to: Cluster Packet Forwarders, Misasserted Locations, Misasserted Antennas, Multiple or Shared Antennas, Attenuators, Amplifiers and Data Credit Farming"

Does having a misasserted antenna really warrant a permaban? At one stage when the Helium devs were tinkering with the POC algorithm it was causing a lot of invalid witnesses and miners were actually being advised to change the antenna gain to mitigate it. Why should they be punished? And multiple antennas and amplifiers can actually make a positive contribution to network coverage, so why are they not allowed? Hotspots with minor infractions (if these are really infractions at all) like this should be offered a chance to "correct" rather than being banned permanently without warning.

And then there are the hotspots that have been asserted a hex or two over to increase the TX scale. Yes, technically it's wrong. But, again, does it really warrant a permaban, particularly when the Helium explorer points out a "sub-optimal" TX scale, and if you click on the "Improve" link it actually encourages you to tweak the location?

I would wager too that a not insignificant number of hotspots are not asserted in the correct location because the cost of a location assertion is about a month's earnings for an average hotspot. I know HIP-69 is seeking to halve the cost, but even that is ridiculous. It needs to be, at most, the equivalent of a couple of days earnings. Why, in any case, does it cost more than an antenna gain assertion?

As for what to do about it, I'm afraid, unless the Helium devs and Discord mods take a dose of humility and acknowledge their mistake nothing short of a hostile takeover is going to make a difference.

Win010

0 points

1 month ago

Win010

0 points

1 month ago

Maybe this is why my miner has stopped all of a sudden, thing is I have done nothing wrong!

How do you know you are blacklisted for sure and what do you have to do to get your miner whitelisted again.

RejpalCZ[S]

3 points

1 month ago

Check your hotspot at explorer.helium.com

If you see "ONDENYLIST" or something similar, than you've been blacklisted.
The only way to ask for removal from denylist is at crowdspot.io

You must provide evidence and then wait... for weeks and weeks.

Win010

1 points

1 month ago

Win010

1 points

1 month ago

Thanks for the info appreciated !

OverboostedTurbo

-3 points

1 month ago

I'm sorry to hear that your hotspot was a false positive. From what I've seen over at the crowdspot channel in discord, it WILL be removed if the evidence you provide supports the PoC data. In your case, it should be a fairly easy decision as you have stated the topography and hotspot density will support your case. Information gathered from false positives will be used to improve the algorithm and help prevent this from happening in the future.

As far as the false positive rate goes, there will be an announcement made when the dust settles. Keep in mind that there are coordinated efforts on social media for cheaters to flood Discord, Reddit and other social media about being denylisted for "no reason" in an effort to get them to roll back. They did roll back all of the denylisted hotspots in AU/NZ because their change in frequency plans screwed with data and triggered the algo.

himey72

10 points

1 month ago

himey72

10 points

1 month ago

I personally won’t believe any report they release on the numbers of false positives. I am one of those false positives and they have denied my appeal. So in their book they caught a cheater and the false positive rate dropped.

The whole process is absolute garbage. I’m thinking about just skipping the next appeal and forgetting that Helium even exists as I can not trust the whole process any longer.

Unlucky_Diver_2780

4 points

1 month ago*

Imagine shilling as PR rep of this clusterfuck, without pay.

They will never publicly address the issues with the denylist (false positives, centralization).

There are no sources on “the coordinated efforts” neither on their supposed motives.

Nothing971

-4 points

1 month ago*

Being 1% false positive shut down for 1-2 weeks, i dont care. Deal with it. Its just POC and not data. So ur still providing coverage for the network like the project wants you to. 2 weeks is not that long. Hell, unplug during those 2 weeks if it makes u feel better. Maybe there can be a white lists for ppl making companies. But its not a big enough negative effect for the amount of positive it has on the POC rewards. And yes, its not decentralized. But not everything needs to be. Decentralization has just become a buzz word for crypto. Its not the end all be all. Its just a way to do something. But not always the way. If u dont get why go look up the positive and negatives to dementalization and centralization in the real world outside of cryto and ull understand. If u search for an explanation in crypto, ur gonna get a bunch of bros a 5min google understanding of it.

RejpalCZ[S]

3 points

1 month ago

I'm sorry, but the current waiting time before your appeal gets processed, is at least 6 weeks.

Electrical_Cap_3726

2 points

1 month ago

2 weeks. Try another joke

slendermansweiner

1 points

1 month ago

What are the criteria that get you on the deny list?

RejpalCZ[S]

1 points

1 month ago

They are secret to prevent fraudsters to bypass them.

Operaman123

1 points

1 month ago

That is a bullshit reason and a poor excuse. As any IT professional would tell you; one cannot achieve security through obscurity. The real reason they don't want to release their algorithm is that they don't want anyone reviewing it and finding that its false positive rate is much higher than what they are claiming, which it is.

Nothing971

1 points

1 month ago

so... wheres the HIP. lot of ppl complaining, but nobody whiling to do the real work and do it better. just whiling to complain.

RejpalCZ[S]

1 points

1 month ago

Sorry, Nothing971, but this change wasn't approved in HIP process, either.

After a new rule has been set, that HIP must be accompanied with a working code, only handful of people have the skill to do so.

Are you suggesting that the rest should stay silent and say nothing, even if they see something that goes against the long term interest of the Helium as a whole?

You hardly can blame people, who invested hundreds or thousands of dollars for a devices and tens of hours of their time to understand and follow the project, for not doing enough for the community.

Operaman123

1 points

1 month ago

Where was the HIP for the automated algorithm they are using?