<< return to Pixycam.com

Pixycam 2 and FIRST Robotics, LabView


#1

Our FRC team wants to use the Pixycam on our robot for the 2019 contest but we are new to vision and the LabView dashboard isn’t easy to adapt to (at least not for us).
Suggestions welcome.
Thanks,
Charlie Affel,
mentor, FRC 423


#2

Hello Charlie,
I must admit that I don’t understand the different FIRST competitions. Some teams/competitions are using Java, some are using LabVIEW. You’re using LabVIEW with RoboRIO hardware, is this correct?

Edward


#3

Hi Charlie,
I found this:

But it’s Java. Is it true that you have a choice between Java and LabVIEW?


#4

yes, exactly.

you can see more about our newest contest at:
https://www.firstinspires.org/robotics/frc/game-and-season

Our challenge is that we use LabView and not Java or one of the lower level languages.
Adaptations, interfaces and subroutines by National Instruments and Woster Polytechnic for LabView sometime fall behind those of the more popular languages.

Right now, we have images from the Pixcam 2 on our windows screen but not yet visible through the required LabView ‘Dashboard’.

We have just three weeks to complete the machine, including driver testing.

Charlie Affel, mentor FRC team 423.
c 215 605 3924


#5

Thanks for the suggestion.
FIRST FRC (Sr. High School) Teams can choose Java or LabView and some C variants.
We have just three weeks left to complete the machine and driver testing, so its too late to change the SW design paradigm to Java for this season.


#6

Hi Charlie,

How are you connecting RoboRIO to the Pixycam 2? I2C, SPI, UART?

I can probably help get data from Pixycam into LabVIEW. Are you using FRC 2019? (http://www.ni.com/download/labview-for-frc-18.0/7841/en/)


#7

Thanks for your interest.
We are using the latest Labview version allowable with updates as recent as mid-January : 2018.

Right now (tonight) we plan to connect the Pixy2 to the Rio using the USB port (for the live video) which must appear on the LabView ‘Dashboard’. for #1 below.
I do have our Pixy2 showing live video as expected on a laptop screen (using the Pixymon program on windows and connected via USB).
We also have a working microsoft webcam to use in testing.

The Robo Rio’s USB port has some limitations and the LabView Dashboard itself can be a hurdle, and so its not a done deal for those steps
Requirements:
#1: Robot mounted cameras are essential to teleoperated driving during the initial 15 second blackout of driver vision.
#2: Next, we hope to have the pixy do some image finding to direct the robot to a colored target on the wall (reflective tape illuminated by our green ring light.
#3: There are also wide lines of tape on the floor to guide the machine the last two feet to an object (scoring opportunity).
I plan to connect the Pixy2 I2c outputs to the I2c inputs on the RoboRio. We have Labview code snippets (vi’s) that were designed (two years ago) to read x-y data directly from the Pixy into Labview.
We are aware of much Arduino and Java work for the Pixy out there. I consider these to be either out of reach or a bit late given our commitment to LabView for the 2019 contest year.
My hope is live within the Pixy’s built in image following capabilities.
The machine must be completed on President’s day and each subteam including programming, is currently maxed out…

Thanks,
Charlie Affel, mentor FRC 423


#8

Thanks for the link.
Assuming the notes are correct, then we are using LabView 2019 (this is an improvement over prior years when we were licensed with a earlier numbered version (frozen ?) of LabView from the prior year all through the contest year.
Again, we have downloaded, installed and updated the entire current Labview suite for FIRST Robotics as recently as two weeks ago. Then re-imaged the Robo Rio after all of this was completed.
It was encouraging that these numerous steps went more smoothly than last year (its a two - three hour process). The error messages are confusing and sometimes multiple tries have been required, no rhyme or reason, just dumb persistence.

CA


#9

For #1, I don’t believe that Pixycam 2 will work as a USB web camera… someone can correct me if I’m wrong on that. (See: http://www.cmucam.org/boards/9/topics/7409)

For #2 and #3, Pixycam 2 is perfect for this… I got my hands on a RoboRIO. Let me get some code in place and submitted to the git repository…


#10

Regarding #1, I’m not sure if this is a UVC kind of thing or possible through some kind of (custom) LabVIEW driver. Pixy2 has a libusb-based C++ library called libpixy2usb that includes a get raw frame function that could be used to rapidly get frames for streaming and/or displaying live video. But I don’t know if libusb and C-code can be used on the hardware in question.

mightysorensen, be sure to check out our porting guide, which includes protocol reference.

https://docs.pixycam.com/wiki/doku.php?id=wiki:v2:porting_guide

Thanks for your help!

Edward


#11

I’ll check it out.

I know that RoboRIO is using Linux (http://www.ni.com/white-paper/14627/en/), so it should be possible to get some frames out.

David


#12

Pixy2 support was added here: https://github.com/charmedlabs/Pixy2LabVIEW

We are initially supporting I2C only. SPI and UART are in the works.

Let us if this meets your needs and how we can improve Pixy2 support for you!

David


#13

Thank you so much, David for this.
I will work on getting our programming team to try it out and spread the word to other Labview teams.

Charlie FRC 423


#14

You’re welcome! Please let us know what is missing so we can improve!

David