-
gingeropolous
would changing --public-node to --public-rpc-node muck things up much?
-
dEBRUYNE
luigi1111: When tag? :-P
-
dEBRUYNE
fluffypony, Snipa: Perhaps available to set the tag?
-
M5M400
tag tag tag
-
hyc
you're it
-
mj-xmr
Guten Tag.
-
M5M400
ideally.
-
selsta
tag is up for those doing reproducible builds
-
binaryFate
yay
-
dgcigbbxfbv
What kind of person steals from own community?
reddit.com/r/Monero/comments/6d5yt5…/what_fluffypony_just_did_is_not_ok Your own leaders are laughing at how moronic you are for falling for thier 'Magical Crypto Friendship'.
-
sech1
Has anyone started reproducible builds yet? I want to try it today, any link to instructions?
-
hyc
mine just finished
-
hyc
just read contrib/gitian/README.md
-
sech1
Ok, I'll try today with Ubuntu 18.04 VM
-
hyc
-
hyc
gitian supports docker and lxc, but I think it's easiest to use docker
-
wowario[m]
sech1: half way
-
sech1
hyc wowario I'm running the build in a VM (6 cores of Ryzen 5600X). How long should it normally take?
-
hyc
2 hours ~
-
sethsimmons
<selsta "tag is up for those doing reprod"> Started, will try to PR signed hashes for the first time today!
-
sech1
still running, but at least I have the same hash for monero-x86_64-linux-gnu-v0.17.1.8.tar.bz2 (I haven't checked others yet)
-
sech1
Running v0.17.1.8 without the ban list on my node now
-
iDunk
-
sech1
-
binaryFate
thanks hyc, iDunk, sech1
-
sech1
I just noticed I don't have Apple build. Do I need to do something more to build it?
-
coffeeroaster
Is the block height off by 2 issue still around? Still seeing it with commit 36dfd41e0 (and no ban list)
-
sech1
looks like it
-
sech1
yes, my 0.17.1.8 node got +2 issue and hasn't banned any IP so far
-
sech1
hmm, and it's back to normal again
-
sech1
Height: 2263568/2263568 (100.0%) on mainnet, not mining, net hash 1.67 GH/s, v14, 64(out)+22(in) connections, uptime 0d 1h 24m 25s
-
moneromooo
We don't care much now since the gui was fixed.
-
sech1
I'll apply the ban list anyway (the one without tor IPs)
-
binaryFate
Probably helps to apply ban list for everyone else, so you don't advertise bad nodes to people who might not be on latest version
-
coffeeroaster
moneromooo: you mean the gui,cli wallets can tolerate the off by two? If so can you explain how?
-
binaryFate
I'm using the ban list that does not include tor nodes, to help tor users. No issue so far with latest tag
-
coffeeroaster
binaryFate: where is that list?
-
binaryFate
coffeeroaster:
gui.xmr.pm/files/block.txt for bad nodes, and
gui.xmr.pm/files/block_tor.txt for bad nodes + tor exit nodes
-
selsta
15:44 <moneromooo> We don't care much now since the gui was fixed. <-- it was not fixed yet, we wrote some code for it but with the memory attack I did not look into it further
-
selsta
coffeeroaster: did you check if the +2 nodes get kicked after a while?
-
coffeeroaster
selsta: I had it running for the past 9 hours or so and off by one still there. Didn't see any evidence of bans. Btw how do I check the block height of each peer?
-
selsta
sync_info
-
selsta
we had to revert a fix that was related to the +2 attack because it had issues with reorgs
-
selsta
we focused on getting a release out because of the oom attack
-
coffeeroaster
selsta: makes sense. wow 10/13 of peers (from sync_info) are in the ban list
-
coffeeroaster
10/12 rather
-
selsta
It did kick +2 nodes in the past days so I wonder if they changed behaviour again
-
coffeeroaster
selsta: might be interesting to add more detail in "sync_info". Are there other tools to detect anomalies?
-
selsta
coffeeroaster: weird... they do get kicked on my node
-
selsta
after like 15 seconds
-
binaryFate
Same here, I see the +2 only intermittently, doesn't last long (~15s)
-
sech1
yes, I saw +2 and then it vanished. Running with the ban list now
-
luigi1111
whoops sorry team
-
coffeeroaster
huh I'll do a new build to be sure then.
-
selsta
Love Windows anti virus deleting stuff while I’m trying to do binaries :D
-
gingeropolous
i just compiled v0.17.1.8 and i still get synchronized OK spam
-
gingeropolous
4000 lines outta the last 10k lines
-
selsta
4000 times?
-
gingeropolous
yep
-
selsta
maybe these are old logs?
-
gingeropolous
i noticed it cause i'm tail -f bitmonero.og
-
selsta
I have been running it for the past days without ban list and don’t get it.
-
selsta
which log level are you running?
-
gingeropolous
an ip just got blocked
-
gingeropolous
yeah sorry old logs. but i was getting it recently, and then it got blocked, and it stopped, so yay
-
sech1
Running without the ban list again, so far so good. No synchronized OK spam, no +2 issue.
-
Inge-
is it easy to try out a reproducible build under docker?
-
sech1
Inge- not that hard, just create Ubuntu 18.04 VM and follow the instructions
github.com/monero-project/monero/blob/master/contrib/gitian/README.md
-
sech1
I had one small issue when the script couldn't connect to /var/run/docker.sock (permission denied), but I solved it by chmod 666 /var/run/docker.sock
-
selsta
-
selsta
I use ^ in a fresh 18.04 VM
-
sech1
And this VM will need more than 10 GB space (VirtualBox default), mine ran fine with 25 GB
-
Inge-
sech1: so I can't just run a docker container in say a 20.04 box
-
sech1
Inge- I don't know, the instructions say 18.04 specifically
-
sech1
maybe it will compile fine in 20.04, but with different hashes
-
Inge-
yeah that would kind of defeat the purpose.
-
selsta
afaik some people use 20.04 for host
-
Inge-
I
-
Inge-
I'll give it a spin. won't hurt to try.
-
coffeeroaster
update: clean build looks much better. Haven't seen the +2 error yet
-
selsta
still probably only a matter of time until the attacker changes his method and it comes back
-
sech1
But what's the point of continuing +2 attack if GUI has been fixed?
-
sech1
I'm expecting something new on New Year's eve :D
-
selsta
it does not have it fixed
-
selsta
we have the code but I did not have time to fully test it
-
selsta
and the ui was not optimized for it
-
selsta
so it looked weird
-
sech1
But but <moneromooo> We don't care much now since the gui was fixed.
-
selsta
we didn’t include it in the release
-
coffeeroaster
seeing regular stack traces in the logs with "allocLargePagesMemory". (also running on non-standard hw RPI4 64 bit)
-
sech1
you need to allocate more huge pages to fix these stack traces
-
sech1
selsta then +2 attack will probably continue. I don't really care since I use CLI, but I'm curious how the attack will be carried out this time.
-
sech1
Height: 2263636/2263636 (100.0%) on mainnet, not mining, net hash 1.65 GH/s, v14, 64(out)+20(in) connections, uptime 0d 1h 29m 9s
-
sech1
This is without ban list, so far
-
sech1
Looks like +2 attack doesn't work on 0.17.1.8
-
sech1
But I don't see any banned IPs either
-
coffeeroaster
sech1: I'm seeing the same (with no bans). Can you elaborate on how to "allocate more huge pages"?
-
selsta
sech1: like I said, we had to revert the +2 fix so they might get kicked because they also try to do the "synchronized ok" spam.
-
selsta
we will see
-
sech1
coffeeroaster sysctl -w vm.nr_hugepages=2048
-
sech1
I use this on my node, but I run both xmrig and monerod
-
sech1
you need to allocate as few huge pages as possible because unused pages will just sit in memory, leaving less free
-
moneromooo
They only get allocated if the mmap flag is set ?
-
sech1
if you change vm.nr_hugepages, they'll be always in the memory, just not used by any process
-
coffeeroaster
and of course my kernel doesn't it
-
wowario[m]
-
selsta
everyone doing hashes please also submit to
github.com/monero-project/gitian.sigs/pulls
-
Snipa
Is there latest instructions for the gitian builds?
-
Snipa
I'll kick one off today.
-
selsta
-
selsta
but I run that inside a VM that I later delete again
-
Snipa
Thanks.
-
mfoolb
trying to gitian build monero but something didn't work out:
paste.debian.net/1179056
-
selsta
mfoolb: did you follow the readme or the steps I posted?
-
mfoolb
-
selsta
can you compare with
irccloud.com/pastebin/m3f2mEuk to see if you did anything different?
-
mfoolb
I'm using Ubuntu 18.04
-
mfoolb
I forked and cloned the gitian.sigs too
-
mfoolb
didn't do your 11 and 12
-
selsta
?
-
selsta
11?
-
selsta
ah sorry, misread
-
mfoolb
row number on your paste
-
mfoolb
-
sech1
I think you need to add --docker to the last line
-
mfoolb
sure I do
-
mfoolb
sorry about that
-
Snipa
Man that OSX cross-compile takes awhile.
-
mfoolb
Snipa: it's probably me but I started from scratch again just to be sure and it stops a bit later:
paste.debian.net/1179066
-
mfoolb
in builder/var/base-bionic-amd64.manifest I find: Reinstallation of linux-modules-extra-4.15.0-126-generic is not possible, it cannot be downloaded. + linux-modules-4.15.0-126-generic and linux-image-4.15.0-126-generic)
-
Snipa
Mine's working fine, just not running the build in parallel for some reason.
-
Mmmmmmmmmm
-
Mmmmmmmmmm
How do I know what the actual method name is for that request?
-
Mmmmmmmmmm
I tried curl
127.0.0.1:18081/json_rpc -d '{"jsonrpc":"2.0","id":"0","method":"blocks_by_height","params":[1,2]}' -H 'Content-Type: application/json' and curl
127.0.0.1:18081/json_rpc -d '{"jsonrpc":"2.0","id":"0","method":"get_blocks_by_height","params":[1,2]}' -H 'Content-Type: application/json'
-
Snipa
Or more correctly, it is, just not in an obvious way.
-
moneromooo
grep this in core_rpc_server.h
-
ndorf
-
mfoolb
I tried thinking the more doing gitian builds the better but I failed for different reasone with 0.17.1.6 0.17.1.7 and 0.17.1.8..
-
Mmmmmmmmmm
Oh, "Not all daemon RPC calls use the JSON_RPC interface." That part is key. Thanks ndorf
-
selsta
mfoolb: can you post the exact command you used?
-
mfoolb
./gitian-build.py -j 3 --memory 6000 --docker --detach-sign --no-commit --build mfoolb v0.17.1.8
-
SellLast
mfoolb, what is your host system?
-
mfoolb
ubuntu 18.04 on a vm
-
SellLast
is the ubuntu on bare metal?
-
SellLast
people have had issues with using virtualbox on a mac... that's what i'm getting at
-
mfoolb
vm with qemu on ubuntu 20
-
mfoolb
vm with 18.04.5 LTS over 20.04.1 LTS to be precise
-
sethsimmons
Why not just do it natively instead of in a VM?
-
sethsimmons
If you’re running Ubuntu already its simple to just do it natively.
-
sethsimmons
It all happens in Docker containers so the host doesn’t matter as long as you have Docker.
-
mfoolb
I use a VM so every time I can start again from zero and I prefer not to mix those two systems
-
mfoolb
anyway I thought most of you used vm's for gitian builds
-
sethsimmons
You can always start from zero if you just clear out Docker afterwards.
-
sethsimmons
I build reproducible on an Ubuntu 20.04 server with no issues.
-
ndorf
i use VM because i don't want to install docker on my host. but i haven't tried .8 yet
-
ndorf
didn't have any issues with earlier releases, though
-
ndorf
also using qemu/kvm
-
mfoolb
and last but not least in github it states clearly: Gitian host OS should be Ubuntu 18.04 "Bionic Beaver".
-
sethsimmons
Thats what the Docker containers use as a base — that doesn’t need to be the host for Docker itself.
-
mfoolb
ndorf: 0.17.1.7 couldn't work.. was missing some packages giving 404
-
selsta
yea that was fixed
-
sethsimmons
Thats the whole point of doing it in Docker — the host OS doesn’t matter.
-
selsta
afaik there are some things done on host OS but 20.04 is fine
-
mfoolb
well I can surely stay away from vm's but not in that system.. I could try on another one tomorrow
-
selsta
next time you try ignore the readme and try following the paste I posted line by line
-
sethsimmons
My exact commands from an Ubuntu 20.04 base:
paste.centos.org/view/c745d210
-
selsta
that is what I usually do
-
mfoolb
selsta: that was for MAC OSX, wasn't it?
-
mfoolb
I mean the last curl
-
mfoolb
selsta: thanks I'll try those..
-
mfoolb
-
sethsimmons
It’s a necessary dependency for the OSX builds AFAIK
-
sethsimmons
Should only need to download it once unless you wipe all the directories after building for some reason.
-
mfoolb
ok
-
mfoolb
not trace of this on github
-
sethsimmons
If you don’t build OSX you don’t need it.
-
wowario[m]
i did the build on a fresh 18.04 ubuntu droplet on digital ocean
-
selsta
it does say "Note: if you intend to build MacOS binaries, please follow these instructions to get the required SDK." but yea could be explained better
-
ndorf
mfoolb: i'll fire it up in my VM shortly and let you know if i run into any trouble
-
mfoolb
ok thanks.. consider I started from scratch.. I mean gitian.sigs fork and clone too
-
ndorf
oh this is interesting, my old .7 daemon doesn't seem to want to exit on SIGTERM
-
selsta
mfoolb: you can fork gitian.sigs after you are done with building the binaries
-
mfoolb
ok
-
mfoolb
sethsimmons: it surely is me .. I tried on Ubuntu 20.04 LTS.. you exact commands.. I received: bin/gbuild:23:in `system!': failed to run on-target setarch x86_64 bash -x < var/build-script > var/build.log 2>&1 (RuntimeError)
-
mfoolb
-
sethsimmons
Hmm not sure what to make of that, the builds worked fine for me on .8 but I don’t know how to debug actual build issues
-
selsta
mfoolb: there's no error message in your build logs
-
mfoolb
-
selsta
hmm
-
mfoolb
addedd some lines on top
-
selsta
ok yea you are running out of ram
-
selsta
try less parallel jobs
-
selsta
-j2
-
mfoolb
I'll do.. I used -j7 --memory 14000 on a 3900x with 16gb
-
selsta
what did you set your VM to?
-
selsta
or no VM?
-
mfoolb
no VM this time
-
selsta
ok, yea try -j4
-
mfoolb
rebuild or still build?
-
selsta
I don't know. Never used rebuild
-
mfoolb
ok
-
binaryFate
Binaries for new version 0.17.1.8 are available on getmonero.org
-
binaryFate
Thanks to everyone who contributed to this one way or another!
-
agentpatience007
:o
-
mfoolb
binaryFate: thanks to you
-
binaryFate
I'm merely stamping the crazy work of others
-
binaryFate
"crazy" as in impressive, and "crazy" as in actually crazy round the clock in the last days and nights
-
mfoolb
yes, we followed the situation and hard work put into it
-
sech1
Interesting, +2 malicious nodes connect and get kicked quickly:
paste.debian.net/1179092
-
selsta
I assume they get kicked because they also do "syncrhonized ok" spam
-
selsta
we will see
-
tevador
-
mnt_grrrl
looks like the cli linux 64 version has not been updated on the website
-
mnt_grrrl
-
selsta
you might have the old version cached
-
selsta
we still have the website setup wrong, we should remove local caching for redirect
-
mnt_grrrl
that was it.
-
mnt_grrrl
thank you!