It's been a year since the last Dreamstate in San Francisco. I couldn't wait... Jennifer was able to join me on the 2nd day, hopefully it was fun enough for her too:
TF represent, as always
The lineup was solid, with two rooms even. Day #1:
Day #2:
As always, it's about the people:
my friend Aaron
Very nice neopixel backpack, based on my code. Well done:
It was supposed to be Paul Oakenfold playing for us, but sadly he called in sick that day, so a few local DJs stepped in for us, and DJ Mars took over the lead spot for the night. While I didn't love what he played, it was nice to see my friends and DJ Blur playing the 2 hours before that.
While it was not the night it was supposed to be, it was still good times.
Jennifer booked us a table at Meadowood 3 months early when their calendar opened up. It's a competitor to French Laundry in Napa, which features Californian food instead of French food.
It was a fancy 10 course menu, well presented, and not as much food as French Laundry (both good or bad depending on how you look at it).
The food itself was good, including a nice helping of good tasting caviar, but the French person in me was disappointed at the total lack of any bread, and when I asked about some, all they had to offer was sourdough, which I politely declined :)
The desserts were ok, but not to the same level as a French restaurant like French Laundry, but I'm obviously biased :)
All in all, it was still a good meal which we quite enjoyed, and their reservations were easier to get than French Laundry, so that's also a plus. A few pictures:
I inherited 64 strips of mostly 64 neopixels per strip (some were as low as 61, and some as high as 66).
not all the same lengths
64 strips is run as 16 lines of 4 strips of 64 pixels (256 pixels), were tested 4 by 4, as the line of 256 pixels that they were with a Neopixel tester that sends test patterns:
the neopixel tester I'm using, along with a 5V 10A DC converter outputting 8A into the controller (testing full white)
The first 16 lines took a long time (almost 2 full days due to the time to measure everything including the cardboard, cutting it carefully, marking where all the LEDs will go, and then testing as I go along to make sure I'm not repeating something that will have to be undone:
A bit of test from my MatrixGFXDemo.ino code
Then comes the issue of attaching all of this. I decided very early to remove the IP67 protection as the silicon is resitant to virtually all glues, making it very hard to work with. I also had to splice broken LEDs in the strips I inherited, so it's much easier to do without the protective casing. I simply attached the bare pixels with those very stick glue dots:
After about 3 days of work, got 50% done:
Power delivery: getting the wire sizes right is important, but turns out you don't need huge wires for 64 pixels. What I did was connect power from each of them at the end and therefore spread the maxium 10A they can draw to 4 times 2.5A, which can go fine over smaller wires as pictured below. The green wire goes between the Data Out to Data In pins of the strips (3 short green wires only for 4 strips)
The 64x64 array was meant to be 2 arrays of 32x64 for ease of transport, each with their own 60A 5V power supply (when actually 40A would have been enough for each set of 2048 LEDs even if their maximum is around 80A in theory). I used thick 10 gauge wire to make sure the power bus could support 100A or so if needed, even if in real life, it'll never really much more than 20-30A:
power testing, this can replace a small sun ;)
Once 50% was verified to be working fine, the other 50% was still a lot of work, but I didn't have to stop for testing of the power, layout, and design. It took another day and a half to do the other 50% at much higher pace, getting all the little wires cut at the right length in advance, gluing all the strips in one fell swoop (still hours or work), and then all the soldering, with validation at the end:
looking better
yeah!
For anyone contemplating that work, most of the work was:
cutting the cardboard backing to the right size, and marking where the strips were going to go
cutting/fixing all the strips (they were second hand, some were broken or the wrong length)
320 glue points for the strips, one by one :)
cutting lots of little wires to the right length, stripping them
only then does soldering come in
then test each set of 4 strips (64x4) with a special neopixel tester
build the 10 gauge power bus
the hardest thing has been to solder all the little wires to the 10 gauge power bus turns out. They don't like staying together due to size and thermal issues.
and all the twisted pair and wiring on both sides (seemed trivial but it was more work than I thought) to connect to the microcontroller
End result:
ESP32, why not something else like Teensy?
So, my shirt that drives 24x32 uses ESP8266. ESP8266 can do up to 4 lines of parallel output, which is not sufficient for a proper frame rate on 4096 pixels. ESP32 does allow up to 24 lines of parallel output (untested) and can easily do 16 lines of output (110 frames per second for 4096 pixels).
Teensy would would have worked too, but I've had too many problems with teensy, namely:
the hacked up build environment patched on top of some version of the arduino sdk. Recently I've had 30 second pauses before compiles even happen if I'm using the serial port (reported the bug, never heard back, never got fixed). This made sense years ago, but not anymore today that arduino supports other hardware boards "the right way"
newer sdk patch that's supposed to fix things, working even less for me (1.42 beta worked even less than 1.41 when I tried it).
serial output just stopping randomly after outputing X lines, making debugging impossible. This was a big deal for me, I reported it, but never got a fix.
no hypervisor like task that catches crashes and gives you a traceback with line numbers like you get on ESP chips (which really helps for debugging problems). This is also a big plus of ESP chips
no onboard flash usable for an SPIFFS filesystem (like the 4MB of flash on ESP32). Now, I'll have to admit that SPIFFS starts falling in performance due to how it's written when you reach 1MB or more of data, but it could be fixed with a better driver and beats no onboard filesystem at all on teensy (you need the 50-ish dollar teensy 3.5 to get an sdcard reader)
closed bootloader that prevents better debugging, and maintained by a single person who is very helpful, does a lot of work, but cannot compete with more open chips maintained by multiple people. It pains me to say this, because Paul Stoffregen does an incredible amount of work for one person, but he remains one person with a closed bootloader design and a hacked up SDK (sorry to say it). Compare with ESP32 which has near real time support on https://gitter.im/espressif/arduino-esp, plus https://github.com/espressif/arduino-esp32/ .
and not that it really matters to me, but despite all these issues, teensy costs at least 2 to 3 times the price of ESP32.
Teensy 3.6 is 32 bit 180/240 MHz ARM Cortex-M4 single core vs 32-bit LX6 microprocessor, operating at 160 or 240 MHz dual core
Teensy 3.6 is 1MB of flash vs 4MB of flash for ESP32 (which can be segmented for OTAs via Wifi and SPIFFS filesystem)
Teensy 3.6 has 256KB vs usually 4MB of SRAM on ESP32, huge difference
ESP32 is dual core (although that adds complexity), adds Wifi and BT vs built in sdcard on teensy
Teensy has more pins but requires an expensive breakout board to use them all
I think teensy 3.1 (now 3.5/3.6) was the best chip around for many years, but honestly ESP32 seems like a better solution for most needs, especially debuggability. This is not to say that Teensy 3.6 is a bad offer, it does a few things better than ESP32, but at a much higher cost, and its SDK and problems explained above, make it a less desirable solution for me.
Why not use those premade 32x32, 32x64, or even 64x64 panels?
This is a very good question. First, they don't exist for neopixels, they exist for a different lower tech solution that requires a lot of work to drive.
It's a lot easier to get a lot of pixels for not much work on those panels: https://www.adafruit.com/product/2276 , but they are more bulky, don't bend at all, and driving them is a lot more work than neopixels. Sadly, because they require row scanning (like an old CRT TV), they also don't look good if you move them, move your head, or take a picture.
Turns out that those panels can be made bendable too now: https://www.adafruit.com/product/3803 but still, they don't seem to come in bigger pitch sizes, and still have the persistence of vision problem I just described.
In the case of a big display, neopixels that usually require too much space (high pitch), actually come out ahead if you want your display to be 1m^2. RGB panels come out ahead for smaller displays with high resolution, you can go as low as 3mm pitch, which beats all existing neopixels: https://www.adafruit.com/product/2279 .
If you want to go higher sizes with those RGB panels, it gets more complicated without an FPGA and arduinos typically can't run more than 32x64, meaning you need 2 arduinos to run 64x64, unless you get this https://www.adafruit.com/product/3649 but then it's apparently only supported by a special controller for rPI.
My point here is that neopixels cost more, but they're a lot easier to drive, despite the timing issues you start running into when you're driving a lot (the more you drive per line, the lower the refresh rate, putting a reasonable limit for a single MCU around 10,000 LEDs if you're ok with a 35Hz refresh rate).
I personally wish for Neopixel matrices that ship in 32x32 or higher, potentially with the option to inject a new data line every 256 or 512 pixels (so you can drive them as one big slower array, or cut the data line in the middle and inject parallel data lines for faster refresh rates.
Wiring and Level Shifters
I first did it wrong by wiring directly to ESP32. This was doubly a mistake because there is sadly no standard pin numbers between ESP32 boards, meaning that I had to re-wire my plugs if I changed chips:
My other problem was that while 3.3V output worked ok enough, when using Yves Basin's 16 line parallel output code, the software built waveforms didn't work well enough at 3.3V. I had to add level shifters, which also nicely added a level of indirection between my cat5 twisted pair cables and the pin numbers on the chip:
Later, I changed one more thing which was to reomve the bidirectional level shifters that were unnecessary and caused issues at boot on ESP32 by messing with some IO pins. Turns out I had go make sure GPIO2 and GPIO12 were low at boot or flashing and reboots would fail (hence the resistors in the picture). However, I ended up replacing them with simpler 74HC245 unidirectional level shifters which don't mess with I/O pins and removed the need for the resistors
Software
Thankfully I was able to leverage the weeks/months of work I put on https://github.com/marcmerlin/FastLED_NeoMatrix and then demos I wrote for it, or shamelessly borrowed from more talented programmers :)
I then spent a lot of time on my https://github.com/marcmerlin/NeoMatrix-FastLED-IR code that ran my Neopixel shirt and adapted it so that its demos would work on a 64x64 matrix while skipping the handling of neopixel strips that are on my pants and arms. I then did a recording of the entire set of demos, including 64x64 animated gifs I found and liked, and ended up with 41mn:
Conclusions
The build was a lot of work, no fun at all: over 4 days of solid work... If you do this, strongly consider getting pre-built matrices that are ideally at least 32x32. Sadly most of the ones for sale today are 16x16 which still means getting 16 of them for about $500, laying them out and soldering them. It's not trivial work either if you re-inject power in them in more than one place, but clearly less work than laying 64 strips by hand like I did.
Get power right. I had some experience there, so I did my math beforehand and verified as I went along. It's not so hard to change a power supply, but it sucks if you have to replace all your power wires you spent so long to cut and solder.
Software is key of course. Running 16 strips in parallel requires some work from a small embedded CPU. Doing Infrared at the same time is not trivial. You can look at my code on how I got it to work, including this bug I found: https://github.com/espressif/arduino-esp32/issues/1781
The RMT driver on ESP32 is great doing doing DMA to 8 lines and either doing infrared without interrupts (sadly I found no IRRemote compatible RMT driver for arduino), or for outputting 8 lines of neopixels at once without big banging from the CPU (this is the FastLED Neopixel driver that Sam Guyer wrote). 8 lines only gives 55fps for 4096 LEDs, while 16 lines gives a nicer 110fps and leaves the RMT driver free for IR Receiving (putting aside that there is no driver at the moment).
I couldn't have done this without plenty of great work from others, be it the FastLED authors and contributors, Yves who offered his suport since he did a bigger build than mine, and his 16 line parallel driver, Jason Coon and others for the Aurora SmartMatrix demos I was able to use, and Mark Estes for even more LEDMatrix demos he wrote and that I was able to use too. Thanks all.
Niko Zografos, who recently got to play at a State of Trance, honoring all of Trance Family SF, organized a 4 year anniversary party for Phoria 4 with a great Trance lineup.
It was fun to go out again and enjoy the music in a new club I had never been to: F8 nightclub in San Francisco. They setu pa bad ass laser that DJ Blur was having a fun time playing with :)
Jennifer got a reservation for us at Sushi Yoshizumi in San Mateo for my birthday. It was a bit in the style of Sushi restaurants you can find in Ginza, although maybe not exactly to the same level, but at least the best you can find in the bay area :)
It was pretty and yummy :)
I had heard about Ephemerisle a few years back, but the schedule didn't work out until this year. Stellar Grey was nice enough to invite us on DIYsland, the 2nd main island after the Elysium complex. Much smaller, but also fewer sharp edges :)
While I wasn't able to help with the far away build in Oakland, I was able to work on a solar charging system that provided a lot of DC charging for cell phones, radios, lipo batteries, and other batteries:
happy customers
the word got around, more happy customers :)
1.6Kwh served after 3 days, not bad (about 1/3rd to 1/4th of what an apartment uses in a day)
Being on DIYsland meant that we had to boat everywhere though. Elysium was "just across" but not really close enough that you'd want to swim there. The current was strong enough that it was hard to get to with our crappy inflatable at times (which I chose over a kayak to avoid rollover risks)
Sadly, Elysium which was full of sharp edges, wood splinters and things that would cut you (my pants got ripped on the first day), or puncture your inflatable, put a huge tear in our inflatable on the 3rd day:
it was long enough that patch kits didn't cover the tear. Duct tape did though
The problem with duct tape is that it's not really water proof. I was able to use duct tape to hold for a 5mn ride back to our island, and it prompty failed and deflated after that, thankfully when I was safely out of the water. Now, it's not that I can't swim, but I was full of electronics that don't like water at all, and ending up in the water at 02:30 in the dark and in strong current, is not the best thing ever. So, I superglued the duct tape for better water resistance and then duct taped the shit out of it:
It probably still wasn't long term water proof, but held enough to get me to Elysium and back on the last night, even if the ride back was somewhat enerving given that I had so much electronics on me (my shirt pants, and batteries don't really go in a dry bag).
My shirt is nice, but it just isn't made for swimming :)
Anyway, we drove to Pirate's Lair on Thursday and got picked up for a quick-ish boat ride to DIYsland:
home sweet home for a few days
our island because it got expanded a few times
we had entertainment :)
and evening music entertainment
On thursday afternoon, we went to Elysium to see the Sean Frenzy Commemorative Competitive swim that re-enacts Sean swimming away from the coast guard while on acid and running on land naked to get away from them (they did eventually catch him and released him later when he was feeling better :) ):
the winner won by quite a bit
for extra points he even ran to the helicopter
it went for a few flights during the week
also a water plane
The Elysium complex was "interesting", the connecting "roads" however moved and disappeared a few times during the next few days, temporarily standing people on one side or the other of the complex:
floating RV, nice :)
blues house
Interesting boats and floating things:
a bunch of other boats were rafted up together
great RV boat
submarine even
More Elysium shots:
humans vs zombies
I even managed to run into my friend Shawn on the last evening
Some overview pictures:
Some sunset pictures:
Night was "interesting". By then, you kind of forget that you're only on a small river. It feels like you're in the middle of an ocean and that you'd better make your destination, or you could perish at sea :) This definitely made a difference when I was riding that could fail anytime raft on the last night.
Johan made a remote controlled kayak that shot fire:
Of course, night had partying. There was an awesome DJ boat:
Blues House had music of course:
DIYsland also had dancing, music and singing:
Some other boats paired up on saturday with the DJ boat for their own party. I only went to check it out once due to the untrustworthy duct taped raft:
The barge had a big dancing platform:
The trip back on Sunday was "interesting". I accepted an early-ish ride back to Pirate's Lair, but in the end it took over 2.5h to get back instead of 10mn because we were towing platforms and people which divided our speed by 10x:
did anyone call for pizza?
it was a long slow ride...
this is what I should have brought ;)
after way too long, we got back to Pirate's Lair
Thanks to all for all the hard work building and then taking back down this big city on water.
I hadn't yet gotten the chance to drive my racecar at Laguna. Sound limits are of course a problem. A 105db day sounded like a great idea. It was cheap enough that I rented 2 spots, one in race cars, and one in advanced group, both with open passing.
As luck would have it, I still got blackflagged for pulling a 106.3db, which thankfully got fixed by turn pipes that I had, but hadn't been installed on the car. This got fixed quickly. Some very nice cars were present.
The morning was overcast:
A few cars:
my car
with the turnpipes installed
Thanks to my coach, I got down from 1:40:xx to 1:32:xx on a couple of laps after fresh tires. On the better morning track, the car could have been faster still, but it sure was hard to find clean laps.
This was a long day for me since I got 7 sessions of 2x20mn, or over 4h30 of driving with just 20mn breaks in the middle. I was quite tired by the end of the day, but was still able to get close enough to fastest laps around the last sessions, until I had to get off the track due to a car that caught fire.
Here is my best lap where I did a 1:32.x, my best laguna time so far, and it wasn't even a clean lap as I had to pass a car (in the Mclaren 650S, I only got down to 1:40.x). My car can likely do 1:30 or even a bit lower:
ETD had a photographer that did a great job getting nice shots of me. Thank you for those. A few below:
Sadly, a nice Mclaren caught fire during the last lap. My guess is that a fluid leak hit the exhaust:
While we were home, a heard a hard thump. A young little bird flew right into our glass door. I found it on the ground, where thankfully it was just stunned. I was able to pick it up, and after a minute or so, it was able to fly off, looking good enough.
This is about https://github.com/marcmerlin/AnimatedGIFs
Louis Beaudoin published a gif decoder for arduino, which was designed for SmartMatrix and Teensy, and used for the Aurora Project. It also required an sdcard since Teensy does not have onboard flash.
With his encouragement, I took his code, and ported it to my FastLED::NeoMatrix library which allows using neopixels as matrices.
I also added support for the SPIFFS on ESP8266 and ESP32 (built in flash memory filesystem on ESP chips, which allow working with any sdcard at all).
Here is the resulting code: https://github.com/marcmerlin/AnimatedGIFs
If "I just want to to display a GIF on my NeoMatrix", then I direct you to SimpleGifAnimViewer.ino which is a mere 60 lines of code if you remove the comments.
And it looks like this:
