2019 - dkurt/opencv GitHub Wiki

2019 OpenCV Meeting notes

Meeting_notes

Template

<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-mm-dd

Agenda

Minutes

To Dos

  • Name
    • todo
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-07-10

Agenda

  • GSoC
  • Patents

Minutes

  • GSoC
    • Need weekly reports, Gary will write about
      • No update on face, tomorrow. Student was sick
        • Before that, all the official tasks are already done (we are now on stretch goals!)
      • Curating Deep Nets for the OpenCV DNN Module
        • 2 Pull requests are in (cover more layers, now extending high-level domains)
        • ONNX format (weight) ... 4 or 5 hight level domains
          • Not covering full ONNX approach (loop unrolling, vectorized, Halide)
          • Don't know the internal roadmap of Intel. LLVM
            • Sooner or later it will all be unified on the backend (unified C++)
          • Open-Vino (all open BSD or not)
          • Regression into landmarks "domain" (coordinate regression)
      • Data augmentation module
        • Risk
      • Improve the performance of JavaScript version of OpenCV (OpenCV.js)
        • going well
      • Dynamic fusion
        • going well
  • OpenCV plans
  • Patents
    • Possibility of acquiring $80K (but will be $100K later in legal fees)
      • Keep out of patent troll hands
      • License to 2 companies to recoup costs

To Dos

  • Gary
    • OpenCV governence
    • Remind students and mentors for reports every week
    • Need to know how to access docs and answers list
    • Contact to Intel team about seamless integration of model zoo and DNN and mentoring them
    • Get in workshop outline
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-06-03

Agenda

  • New OpenCV release
  • Strategy DNN
  • GSoC

Minutes

  • New OpenCV release this week or next
  • DNN
    • Need active model zoo
    • Need to make sure that all the layers are in DNN
    • Support ONNX completely
      • What version of ONNX? 4, 5
      • With Diego layer coverage is done by cherry picking of models
        • Missing layers, datatypes
      • Importer based on the cherrypicking
        • When you take the model, you only see the first error
        • Would rather see all the list of missing layers
        • There is a list of supported layers
      • What is the roadmap for ONNX?
      • Issues in porting a model
        • Missing in importer
        • Some datatypes not supported
        • Missing parameter configurations
        • Example
          • MDN layer was in DNN but not in importer
          • Alternate implementation -- different issues, loop unrolling
    • Evolved by model cherry picking
    • NVidia inference engine in github already embedded in the tensorflow option
      • Open sourced on github (CUDA) tensor RT stuff
      • Parse over the graph -- ONNX inference
    • Microsoft ONNX inference is useful to look at CNPK (deprecated). Going instead at ONNX runtime
  • GSoC
    • Need to get weekly reports
    • Updates for the OpenCV projects
      • Facelandmarks none were trainable
        • Trainable models now
        • No python bindings, now have them (sent and approved pull requests)
        • API 2 disjoint inheritances, now united
        • Wasn't training code, now is
        • The work of 3 people done by one
        • 3D landmark detection paper (2D inferring 3D)
      • Curating Deep Nets for the OpenCV DNN Module
        • Semantic seg, landmarks, mask-RCNN (instance segmentation? Ask Dimitry)
    • 2nd GSoC evaluations July 22, see GSoC timeline
  • Kornica
    • Adam optimization from pytorch
  • Courseware (Aug and Oct)
    • 1.4K people (don't have to join immediately) -- closed enrollment temporarily for roll out
    • Only need working knowledge of python
    • 3 planned courses
      • Then Next set will be decided
    • Companies are buying course bundles
      • Can others offer mentoring

To Dos

  • Gary
    • Remind students and mentors for reports every week
    • Need to know how to access docs and answers list
    • Contact to Intel team about seamless integration of model zoo and DNN and mentoring them
    • Get in workshop outline
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-05-08

Agenda

  • GSoC get mentors started

Minutes

  • GSoC
    • Replicate pytorch model zoo (we need named ONNX model -- very convenient)
  • Docs and Answers lists -- need to know how to access this

To Dos

  • Gary
    • Get new Intel contact
    • Add a mentor from inside of Intel for model zoo DNN
    • Need to know how to access docs and answers list
    • Contact to Intel team about seamless integration of model zoo and DNN and mentoring them
    • Get in workshop outline
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-04-42

Agenda

  • GSoC
  • Talks

Minutes

  • GSoC
    • Waiting for slots
      • After we get them, we'll use the spreadsheet for priorities.
      • I like the notion of focusing on a few pieces instead of scattered
      • Face then body would be good themes for DNN
      • Future (not this GSoC)
        • Dual or triplet net for giving a feature distance
        • Segmentation
  • Talks
    • May:
      • Huawei OpenCV, Robotics
      • Shenzhen U Robotics (Vadim there)
      • Chinese Academy of Sciences OpenCV (if set up)
      • Baidu
    • Summer:
      • Moscow OpenCV, Robotics

To Dos

  • Gary
    • Get new Intel contact
    • [-] Apply to Google Season of Docs
    • Contact to Intel team about seamless integration of model zoo and DNN and mentoring them
    • Get in workshop outline
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-04-17

Agenda

  • Oss-fuzz -- eliminating vulerabilities in code
  • GSoC
  • New Websites for OpenCV
  • GSoD (Google Season of Docs)
  • OpenCV talks

Minutes

  • Oss-fuzz
    • Thanks to Google lending us ginormous server farms, we're finding and stamping out lots of subtle potential vulnerabilities in OpenCV.
    • Good reason to switch to the latest updates.
    • Turns out almost all open source is riddled with these, but the Google program is helping a lot.
  • GSoC
    • I need to get real mentor numbers
    • Then provide priority (min) and all real (max) numbers to Google
    • We have 128 applications and 23 mentors. We'll see what sticks
  • Website
    • New OpenCV website is going live today or this week latest
      • It will give us more interactivity and much better stats
      • OpenCV now gets 2M(!) downloads per WEEK(!)
    • New OSVF Website
      • Couple of days later than OpenCV
      • Need to think how to leverage
        • Need to give sub-admins access to the new site
  • GSoD
  • OpenCV talks
    • Need to develop a new set of materials for OpenCV
      • Satya gave a list of new stats etc
      • Add in robot demographics
      • Have lots of examples from Arraiy, and other talk material on robotics and startups
    • Series of talks coming up
      • China
        • Shenzhen University
        • Huawei
        • Russia Seeing Machines
        • Cisco
        • Prior talks at Mercedes a few weeks ago and society of artificers

To Dos

  • Gary
    • Get new Intel contact
    • Apply to Google Season of Docs
    • Contact to Intel team about seamless integration of model zoo and DNN and mentoring them
    • Get in workshop outline
    • [-] Contact Open3D about a possible project
  • Satya
    • Get new OpenCV Website online
    • Get OSVF website online
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-04-03

Agenda

  • GSoC
  • Google Season of Docs

Minutes

  • GSoC
    • Need to get mentors to go through our 272 applications (!) (548 on our student list!)
  • Google Season of Docs, need to apply by the 23rd
    • We can recruit some from our list of 548 interested students, but technical writers don't have to be students.

To Dos

<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-03-27

Agenda

  • GSoC Student Choosing

Minutes

  • GSoC
    • We are now in the period where students apply through Google to us
      • We need to send out a reminder message to get Google applications in
    • Model zoo for DNN currently means

To Dos

  • Gary
    • [^] Contact to Intel team about seamless integration of model zoo and DNN and mentoring them
    • [^] Get in workshop outline
    • [^] Contact Open3D about a possible project
    • Define a "SLAM"ish task.
    • Add to mentor list
    • Update timeline
    • Send out a reminder message to students and mentors to apply during this time
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-03-20

Agenda

  • GSoC
  • Google Summer of Docs
  • Chips
  • Python

Minutes

  • GSoC
    • look into gooogle summer of docs.
    • Get mentors going on sorting through students.
      • 165 applications to opencv from our site
      • 447 Students on our student list. Need to sort down
    • Students need to come up with their actual plan. Mentors need to find and refine
    • Already people on (sample)
      • Facial landmark focus (Satya)
      • Alpha matting (Sunita)
        • Non deep grabcut, alpha matting
      • DNN GPU (Davis King) Justin
  • GSoDocs
    • Here is the timeline
      • Application is due April 2nd
  • Embedded chips. OpenCV should work with
    • Jetson nano
    • TPU
    • Intel
    • Other? Huawei? Smart cameras?
  • Python is very important to opencv/vision (OpenCV python wrapper is getting 1M downloads per week!)
    • If you look at the OpenCV docs, for example here, it looks all C++
      • Only when you click to the actual function, for example getPerspectiveTransform do you see, below the C++ interface is the python interface Python: retval = cv.getPerspectiveTransform( src, dst[, solveMethod] )
    • Possibly we can use Google summer of docs to bring out the python interface more

To Dos

  • Gary

    • Email mentors to look at application list and get back to mentors
    • student list reminder to sign up
    • Get in workshop outline
    • Bank information
    • Contact Open3D about a possible project
    • Define a "SLAM"ish task.

  • Satya

    • Look into Google summer of Docs how it might be useful for OpenCV
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-03-13

Agenda

  • GSoC

Minutes

To Dos

  • All
    • Contact Profs for students/C++ people We have almost 450 students interested
  • Gary
    • Get in workshop outline
    • Bank information
    • Contact Open3D about a possible project
    • Define a "SLAM"ish task.
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-03-06

Agenda

  • GSoC
  • Workshop

Minutes

  • GSoC
    • Long discussion, not written down much. Summary:
    • We are going to use an application process similar to Liquid Galaxy
      • We already have a new mailing list in testing for this: [email protected]
      • Applicants will select a project title, send motivation, resume, proof of code
        • We will create a google form for this
      • The responses will be filtered by Satya's group to toss out obvious under thresholds
      • The survivors will go to mentors to decide
      • A spreadsheet will be created to make sure each resume has been replied to and processed
    • We will encourage only the survivors of the above to officially apply.
  • Workshop
    • Gary still has to get outline doc in. Need an answer for financial support

To Dos

  • All
    • Contact Profs for students/C++ people
  • Gary
    • [^] Get in workshop outline
    • [^] Bank information
    • Put up new process
  • Satya
    • Test email
    • Create google form
    • Get info to Edgar for his promotion notes
  • Edgar
    • Finish promotion notes
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-02-27

Agenda

Minutes

  • GSoC
    • Recruit students
    • If you

To Dos

  • Name
    • todo
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-02-20

Agenda

  • Website
  • GSoC

Minutes

  • Website
  • GSoC
    • Asked interns to go through the GSoC process
      • Can log in but obviously nothing else to do
      • Can join our mailing list
    • Nothing the org can do until Feb 26 when Google decides
    • Haven't talked with Samir, could be good SFM/SLAM lead
    • Slac channel, who is on?

To Dos

  • All
    • [^] Contact Professors
  • Gary
    • Ping Bart and Moriah about https://my.studiopress.com/themes/studio/#demo-full
    • [^] Contact Profs for students/C++ people
    • [^] Finish reading workshop/conference doc
    • [^] Send in above doc to Bruce
    • [^] Contract on vision course
    • [-] Post Satya's formal post to Reddit, Twitter, LinkedIn
  • Satya
    • [^] Create a formal post for posting, send to others to vet, and then see all above
    • [^] Maybe focus SLAM for GSoC on the ability to run on mobile
  • Edgar
    • Give Gary contacts with Computer Vision Center in Barcelona
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-02-13

Agenda

  • GSoC ideas
  • Future conference
  • Differential geometry

Minutes

  • OpenCV GSoC Ideas
    • Nothing much to do right now. Ideas list is here
    • SFM
      • What to do
        • Basic building blocks and whole thing is there in opencv_contrib
        • More real time?
        • Dense?
        • Occipital-ish 3D?
        • Add deepnet descriptors
      • SW base to interact with ARKit *
        • SLAM for mobile
    • Davis DNN-GPU
      • Student good at C++, know or learn Cuda
      • Can take dlib or pytorch
    • Can emphasize the GSoC OpenCV user group the Wiki to Google groups
  • Differential geometry -- Decide how to integrate/interoperate w/OpenCV
    • different losses for image reconstruction
    • AR labs
  • Future conference/workshops
    • People Computer Vision Center from Barcelona to get involved

To Dos

  • All
    • [^] Contact Professors
  • Gary
  • Satya
    • [^] Create a formal post for posting, send to others to vet, and then see all above
    • [^] Maybe focus SLAM for GSoC on the ability to run on mobile
  • Edgar
    • [^] Give Gary contacts with Computer Vision Center in Barcelona
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-02-06

Agenda

  • Business meetings
  • GSoC 2019

Minutes

  • Business meetings
    • We have started Thursday business meeting of professionals who can move the foundation to higher gear/professional footing. I believe I will post summaries here scrubbed of financial and business private info
      • First priority is to get workshops/conference enagement going
  • GSoC
    • We can put more ideas on our page
    • Current ideas list:
Index to Ideas Below
Circular Calibration Data Augmentation GPU backend for DNN Binary Neural Nets
Model Zoo Point Coordinate Regression Differential Rendering Image Processing
April Tags Optical Flow Python OpenCV Depth Fusion
Face Landmarks Boosted Cascades Machine Learning Tutorials OpenCV GUI
  • Priorities:
    • GPU backend for DNN -- very necessary that this is a complete package
    • Place to get curated DNN models especially for face, body, hands -- anything human
      • I would priortize binary models too, but that will depend on Michael's theoretical/mathematical guidence ... and luck of finding the right student
  • Look into LFS on Git for storage of deepnets
  • Create a formal post
    • Post to Reddit, Twitter, LinkedIn

To Dos

  • All
    • [^] Contact Professors and Students
    • [^] Send out formal posting from Satya
  • Gary
    • [^] Post to Reddit, Twitter, LinkedIn
  • Satya
    • [^] Create a formal post for posting, send to others to vet, and then see all above
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-01-30

Agenda

Minutes

  • GSoC Ideas List
  • Python wrapper stays universal
  • Satya posted list, will post to site
  • Highest priority is Cuda backend for DNN
    • U of S Calif
  • SFM continuation
  • Contact Professors
  • Data augmentation

Template for ideas list

  1. <Descriptive Title such as "Deep Nets">

      • Description: 3-7 sentences describing the task
      • Expected Outcomes:
      • Skills Required: < for example: mastery plus experience coding in C++, college course work in vision that covers optical flow, python. Best if you have also worked with deep neural networks. >
      • Mentors: < your name goes here >
      • Difficulty: <Easy, Medium, Hard>

To Dos

  • All
    • [^] Contact Professors
  • Vadim
    • Get mentors and ideas
  • Gary
    • Complete editorial clean up of Idea page
    • Get point of contact to Vincent to OpenCV Dev team
    • Get Satya's list up
    • [^] Contact professors
  • Satya
    • Contact student GPU backend for DNN
    • Sameer for SFM
    • Adrian for python tutorials
  • Edgar
    • Get mentors and projects up
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-01-23

Agenda

  • GSoC Ideas

Minutes

  • Priority Ideas categories
    • Port DNN to GPU
      • Add a base network that can have top layers learned/tuned and easy access to DNN
      • Binary CNNs
      • Learning CNNs
      • Curate more models
    • Add differential functions
    • Tutorials
    • Improve SFM
    • HighGUI improvements
  • Make sure this is all cross indexed to the OpenCV Evolution Wiki

To Dos

  • All

    • All Recruit Mentors and Ideas on the wiki

  • Gary

    • Send Citi bank statements
    • Recruit mentors: Michael, Reza, Grace
    • Get a properly formatted idea onto the idea page
    • Review and sign course contract.
    • Reset password for Satya's OSVF account.
    • Connect OpenCV.org website maintainer to Satya
    • Talk to Python Geometry library for GSOC mentorship
    • Search for NVIDIA / Intel Connections for sponsorships

  • Satya

    • Get new mentors (Vikas / Ankit ) to sign up for the group
    • Share a document with potential tutorials
    • Reach out to more mentors
    • Reach out to OpenCV.com owner
    • Search for NVIDIA connections

  • Vivian

    • Start to Organize Citi statements
<><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>

2019-01-16

Agenda

  • Organizational news
  • GSoC Project Ideas

Minutes

  • Organizational news
    • Satya Mallick will be acting as interim CEO for OpenCV. Gary will take the role of President for OSVF and OpenCV. We plan some new initiatives in corseware, consulting and fund raising
  • GSoC Project ideas

To Dos

Meeting_notes

© Copyright 2019, OpenCV team

⚠️ **GitHub.com Fallback** ⚠️