Dev Meeting Notes (Pre 2017) - ckan/ckan GitHub Wiki

https://github.com/ViderumGlobal/ckanext-iati/issues/82#issuecomment-260295713
#1234 - Resolution

General questions:

2.6 https://github.com/ckan/ckan/milestone/9 https://github.com/ckan/ckan/wiki/CKAN-hosting-guidelines

Meeting 2016-10-25

Chair: Notes:

#1234 - Resolution

General questions:

2.6 https://github.com/ckan/ckan/milestone/9 https://github.com/ckan/ckan/wiki/CKAN-hosting-guidelines

Meeting 2016-09-22

Chair: Notes:

#1234 - Resolution

General questions:

get_action is a confusing interface, can we come up with something better for core? (wardi)
- https://github.com/ckan/ckan/issues/3254

Meeting 2016-09-06

Chair: Notes:

#1234 - Resolution

General questions:

http://ckan.org/ckancon-2016/

Meeting 2016-08-30

Chair: Notes:

Pull Requests (6 open) *

Issues (4 open)

#1234 - Resolution

General questions:

CKANCon

Meeting 2016-08-23

Chair: Notes:

Flask PRs https://github.com/ckan/ckan/issues/3196#issuecomment-240748553

https://github.com/ckan/ckan/issues/3119#issuecomment-240719541

#1234 - Resolution

General questions:

GA on docs.ckan.org
(Steven) forking the Ckan.org WP theme to github.com/ckan, shall we?

Meeting 2016-08-16

Chair: Notes:

https://github.com/okfn/ckanext-s3filestore/pull/11

#1234 - Resolution

General questions:

Plan for 2.6
1. Review/merge #3191 (private datasets in search) - amercader
2. Branch release-v2.6 - ping LinkDigital PRs on LinkDigital fork targeting release-v2.6
3. Review/merge Flask migration PRs

Meeting 2016-07-19

Chair: Notes:

#1234 - Resolution

General questions:

2.6 release plan, connecting David and Shane (name)

Meeting 2016-07-12

Chair: Notes:

#1234 - Resolution

General questions:

anything new regarding ckan/ideas-and-roadmap#85 and #47?
Item (name)

Meeting 2016-07-05

Chair: Notes:

https://github.com/ckan/ckan/blob/master/ckan/lib/cli.py#L170

#1234 - Resolution

General questions: https://github.com/ckan/ckan/wiki/Migration-from-Pylons-to-Flask

Meeting 2016-06-23

Chair: Notes:

#1234 - Resolution

General questions: https://github.com/ckan/ckan/wiki/Migration-from-Pylons-to-Flask

Item (name)

Meeting 2016-06-21

Chair: Notes:

#1234 - Resolution

General questions: https://github.com/ckan/ckan/wiki/Migration-from-Pylons-to-Flask

Item (name)

Meeting 2016-06-14

Chair: Notes:

#1234 - Resolution

General questions:

Flask migration
- Update on progress and TODO (WIP): https://github.com/ckan/ckan/wiki/Migration-from-Pylons-to-Flask#approach-and-roadmap https://github.com/ckan/ckan/wiki/Migration-from-Pylons-to-Flask#implementation--things-to-consider
- Merge strategy: https://github.com/ckan/ckan/compare/master...poc-flask-views https://github.com/ckan/ckan/compare/poc-flask-views...poc-flask-views.common-url_for-take-2 https://github.com/ckan/ckan/compare/poc-flask-views.common-url_for-take-2...poc-flask-views.common-url_for-take-2-tests

Meeting 2016-06-09

Chair: Notes:

#1234 - Resolution

General questions:

Fixes to url_for for backporting https://github.com/ckan/ckan/pull/2998#issuecomment-224615278

Meeting 2016-06-07

Chair: Notes:

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-06-02

Chair: Notes:

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-05-31

Chair: Notes:

https://requires.io/github/ckan/ckan/requirements/?branch=master

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-05-26

Chair: Notes:

resource upload tests https://github.com/ckan/ckan/pull/3037 (brook)

#1234 - Resolution

General questions:

unicode_literals https://github.com/ckan/ckan/pull/3049 (wardi)
ckancon 2016 date? (wardi)

Meeting 2016-05-24

Chair: Notes:

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-05-19

Chair: Notes:

Issues (XX open) *

General questions:

Flask migration
Blueprints:
- core: https://github.com/ckan/ckan/pull/2971#issuecomment-220315942
- extensions: https://github.com/ckan/ckan/commit/9cdc19f86e2
url_for: https://github.com/ckan/ckan/pull/2971#issuecomment-220328950
ckan architecture paper https://delftswa.gitbooks.io/desosa2016/content/ckan/chapter.html

Meeting 2016-05-17

Chair: Notes:

#3017 - Welcome Knut!

General questions:

Item (name)

Meeting 2016-05-12

Chair: Notes:

#1234 - Resolution

General questions:

flask views discussion: how do we structure views? how do we override?

Meeting 2016-05-10

Chair: Notes:

#1234 - Resolution

General questions:

comments on security tickets (wardi)

Meeting 2016-05-05 (postponed)

Meeting 2016-05-03

Chair: Notes:

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-04-28

Chair: Notes:

#1234 - Resolution

General questions:

Flask views POC (https://github.com/ckan/ckan/pull/2971) (amercader / brook)
JSONP on POST? - remove it
Webob monkeypatch https://github.com/ckan/ckan/pull/2971/commits/09fd6300bfe - looks good
Routing options https://github.com/ckan/ckan/pull/2971#issuecomment-214779162
i18n options https://github.com/ckan/ckan/pull/2971#issuecomment-215400251 Try 2 first, if not 1 (or flask-babel fork)

Meeting 2016-04-26

Chair: Notes:

#1234 - Resolution

General questions:

Sec issues / access for LinkDigital
question regarding file upload (Nikolas)

Meeting 2016-04-21

Chair: Notes:

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-04-19

Chair: Notes:

#1234 - Resolution

General questions:

https://github.com/ckan/ckan/pull/2959

Meeting 2016-04-14

Chair: Notes:

#2960 - brook
#2959 - amercader
#2956 - amercader to speak to steering group

#1234 - Resolution

General questions:

Policy on 'supported' ckan versions (dread)
- in relation to marking docs - https://github.com/ckan/ckan/issues/2946#issuecomment-208839308 (my proposal (amercader)): https://lists.okfn.org/pipermail/ckan-dev/2016-January/009609.html
http://opengov.com/blog/building-the-connected-government-opengov-acquires-ontodia/
ckan-security for Link Digital

Meeting 2016-04-12

Chair: Notes:

#1234 - Resolution

General questions:

Beaker sessions in db (amercader) cleanup? http://beaker.readthedocs.org/en/latest/sessions.html#removing-expired-old-sessions
Security issues
- ckan-security access for link digital

Meeting 2016-04-07

Chair: Notes:

2908 - nearly there - hopefully merge today (wardi)

#1234 - Resolution

General questions:

Steering group update (dread)

application for session at IODC Madrid (Oct 6-7)
planning CKANcon for day before (a Wednesday)
world-wide sprint / hack flask good, probably not bs3 - design difficult to split up
- expect to attend: chris majewski (canada), ian ward (canada), tyler (canada), okf people yes (with okf summit nearby), dread(hopefully)

procedure for CKAN roadmap (Nikolas)

Meeting 2016-04-05

Chair: Notes:

#1234 - Resolution

General questions:

IODC panel, CKANCon (wardi)
DGU? (wardi)
tracking in package_search (wardi)
Item (name)

Meeting 2016-03-31

Chair: Notes:

#1234 - Resolution

General questions:

Item (name) https://github.com/ckan/ckan/tree/poc-flask-views

Meeting 2016-03-24

Chair: Notes:

#1234 - Resolution

General questions:

Update from SG meeting (amercader)
- ckan events at IODC
- web site discussion
patch release next week (amercader)

Meeting 2016-03-22

Chair: Notes:

#1234 - Resolution

General questions:

one of us join steering group call (wardi)

Meeting 2016-03-17

Chair: Notes:

#1234 - Resolution

General questions:

Patch releases (amercader)

Meeting 2016-03-15

Chair: amercader Notes: wardi

#2909 - amercader
#2916 - brook
#2915 - amercader
#2908 - wardi assigned, amercader and wardi to comment + review
#2917 - amercader

#2911 - good for contribution
#2910 - amercader to inquire about original artwork, good for contribution

General questions:

Item (name)

Meeting 2016-03-10

Chair: Notes:

#2904 - unicode in datastore (wardi)
#2902 - exception in datastore index (wardi)
#2901 - amercader
#2894 - fix extensions

#1234 - Resolution

General questions:

Flask migration:
- WSGI dispatcher: https://github.com/ckan/ckan/pull/2905
- next steps
Tests, glorious tests (amercader)
replace --with-pylons with --with-ckan
reuse one app vs create n test apps (one for test class)
disable travis failures?
LF discussion
ckan 2.6 release - steven to put jason/shane in touch with david to get it started
#2898 to be reviewed by sergey

Meeting 2016-03-08

Chair: Notes:

#1234 - Resolution

General questions:

Flask migration update (amercader / brook): https://github.com/ckan/ckan/wiki/Migration-from-Pylons-to-Flask https://github.com/ckan/ckan/compare/2845-wsgi-dispatcher
demo, master, beta (amercader)
Next steps CKAN association (amercader)

Meeting 2016-03-03

Chair: Notes:

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-03-01

Chair: Notes: ross

Issues resolved, no PRs. Meeting done in IRC.

Meeting 2016-02-23

Chair: Notes:

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-02-18

Chair: Notes:

#1234 - Resolution

General questions:

Issues / PR templates: do we want to use them? (amercader)

https://github.com/blog/2111-issue-and-pull-request-templates

Meeting 2016-02-16

Chair: Notes:

2352 WIP

#2878 - remove db simple-dump-json, recommend ckanapi

General questions:

LF doodle (wardi)

Meeting 2016-02-11

https://hangouts.google.com/hangouts/_/okfn.org/ckan-meeting-2 Chair: David Notes:

#2872 Sergey to review.
#2867 Adria.

#2871 Assign to zharktas ...

General questions:

Supporting the core tech team from APAC (Steven De Costa, starl3n)
update on cleaning up GitHub issues/PRs (starl3n) - ross still doing it
packaging and release for 2.6 (starl3n)

Shane, Yan, Sergey & Greg to look at in next week or so
Begging emails (ross)
Responding to Assoc (ross).
Allow LD team to be assigned to tickets (like morty). Sergey = smotornyuk || Yan = Engerrs Invites sent.
open.canada.ca support for ckan (wardi)
linux foundation cio willing to discuss help setting up ckan under linux foundation with some of their resource
- have paid-for resources - advertising, legal, running conferences, etc
- easier for people to donate money to it -> DR to draft doc and work with Ian & Steven on getting initial feedback from steering committee and organization meeting with Linux Foundation

Meeting 2016-02-09

Chair: Notes:

#1234 - Resolution

#1234 - Resolution

General questions:

keeping core devs working on ckan (wardi)
agpl enforcement (wardi)

Meeting 2016-02-04

Chair: Notes:

#1234 - Resolution

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-02-02

Chair: Notes:

#1234 - Resolution

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-01-28

Chair: Notes:

#1234 - Resolution

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-01-26

Chair: Notes:

#2839 - accepted, amercader will announce

#1234 - Resolution

General questions:

Flask migration:
- Config: https://github.com/ckan/ckan/issues/2842 / https://github.com/ckan/ckan/pull/2843
- Routing: https://github.com/ckan/ckan/issues/2845
ckantoolkit 0.0.2

Meeting 2016-01-21

Chair: wardi Notes: wardi

#2835 - brook
#2840 - wardi
#2839 - discuss at next meeting

#1234 - Resolution

General questions:

Item (name)

Meeting 2016-01-19

Chair: Notes:

#2831 - wardi
#2835 - need to remove magic from h
#2836 - amercader

#2838
- Need to ensure unique email addresses
- Email validation when registering (user as pending, resend the validation email, ...)
- Don't breaking existing instances where email address may be in multiple accounts.
Implement in an extension (even a core one) to not complicate core code
- User extras,
- IUserForm
Core
#2837

General questions:

https://github.com/ckan/ideas-and-roadmap/issues/166 (ross) - Code of Conduct
- Propose we look implementing something like http://todogroup.org/opencodeofconduct/#Open+Code+of+Conduct/
  
  Which has a nice tool at http://todogroup.org/opencodeofconduct/#CKAN/[email protected] and will host it for you.
  
  How do we get to create @ckan.org email addresses? - copy into repo.
Flask migration: work starting
ckantoolkit 0.0.1 https://github.com/ckan/ckantoolkit https://github.com/ckan/ckantoolkit/blob/master/ckantoolkit/__init__.py#L21
BS 3 work continues
user_list, user_show apikey etc.
NHS Site.

Meeting 2015-01-14

Chair: Notes:

#2834 - amercader
#2831 - 404 on package controller only instead
#2830 - wardi
#2829

https://www.djangoproject.com/download/#supported-versions https://docs.djangoproject.com/en/dev/internals/release-process/#supported-versions

#2832 - wardi

General questions:

Broken extensions when used with master aka new_authz in extensions.

add a sepaate Python package ckantoolkit
Close message: https://gist.github.com/rossjones/4e441f65e9bac78b1eca is ok i.e. not too harsh?
Announcements: dropping Python 2.6, min Postgres 9.1
Release support policy: Version | Release Date ---------+------------- CKAN 2.5 | December 2015 CKAN 2.4 | July 2015 CKAN 2.3 | March 2015 CKAN 2.2 | February 2014 CKAN 2.1 | August 2013 CKAN 2.0 | May 2013

Potential approaches to support date limits:

Date based: each release is supported for X months or Y years after the its release date
Number of supported releases: we support the last stable release plus the previous Z ones

Other projects:

Meeting 2015-01-12

Chair: rossjones Notes:

#2829 - WIP
#2828 - WIP

#2827 - amercader

General questions:

Ticket Gardening (ross)
- Close old tickets.
- Use easy/hard labels on Good-for-contribution.

Meeting 2015-01-07

Chair: amercader Notes: wardi

#2825, #2824 - wardi
#2821 - wardi
#2801, #2817 - amercader
#2818 - rossjones
#2815 - rossjones
#1926 - amercader
#2610 - brook
#2800, #2798 - amercader
#2796 - merged

#2826 - amercader
#2822 - rossjones
#2807 ... 2813 - bugs related to demo site. good for contribution?
#2806 - good for contribution
#2805 - rossjones
#2804 - rossjones
#2803 - amercader
#2799 - amercader
#2797 - good for contribution
#2794 - vitor (good for contribution)
#2793 - amercader
#2792 - good for contribution
#2790 - move to ideas?

General questions:

docker and data.gov (wardi)

Meeting 2015-12-15

Chair: Ross Notes: Tom

#2788 - Ross merged

#2787 - wardi
#2786 - ross
#2784 - placeholder for ross PR

General questions: * (dread) Release Thursday. Outstanding issues?

    https://github.com/ckan/ckan/issues/2758

* (wardi) https://gitlab.com/ckan/ckan-security/merge_requests/2

* docs? 

* test? - wardi to do

* patch releases

* test debian packages(ross)

http://packaging.ckan.org.s3-eu-west-1.amazonaws.com//build/python-ckan_2.5.0-trustybeta1_amd64.deb

http://packaging.ckan.org.s3-eu-west-1.amazonaws.com//build/python-ckan_2.5.0-precisebeta1_amd64.deb

BETA Packages are fine on trusty and precise (ross).


* general testing of beta.ckan.org

* (ross) The member table, db relations in general (i.e. owner_org).
  * Also split up orgs and groups? (no, just wishful thinking)
* (dread) Florian has requested we allow bavarian translation. I'm concerned it could open the floodgates to other obscure ones, filling up the language drop-down with, when they are added more for politics rather than necessarily helping understanding. His arguments:
    

Re Bavarian - I'm serious about offering a translation to further CKAN's multilingual diversity, and there are serious movements in Bavaria to preserve this language and our rich culture. However, this is an offer, not an agenda.


Arguments against:

- CKAN will still be usable to Bavarian users without a Bavarian translation, as all of them speak German (although with a funny accent). The same however goes for Catalan and Basque - most Catalan/Basque speakers will understand Spanish, although I recognize due to historical/political tensions, Catalan and Basque speakers will be offended by Spanish-only translations more than Bavarian speakers by High German.


Arguments pro:

- Bavarian is in the list of languages supported by Transifex, it's a legitimate language/locale.

- Bavarian, Austrian and some Swiss-german dialects have Bajuvarian as their linguistic root and form their own language group - all other German dialects come from Middle German and are actual dialects.

- Other languages (en, pt, es) have their own CKAN Transifex localisations too.

- I'm happy to contribute the translation


I'll leave the decision up to you - would be great if you could pitch this to the tech meeting, and I'd be glad tocontribute another bit of linguistic diversity to CKAN if there's no perceived risk involved.

(amercader) flask update

Meeting 2015-12-10

Chair: amercader Notes: wardi

#2783 - brook
#2465 - wardi
#2779 - amercader
#2777 - amercader

#2781 - wardi
#2780 - good for contribution

General questions:

https://gitlab.com/ckan/ckan-security/issues/5
Migrations in extensions
flask proposal:
- https://gist.github.com/amercader/0a497ab81fa30bfeadea
- https://github.com/ckan/ckan/wiki/Pylons-imports#detailed-occurrences

Meeting 2015-12-08

Chair: David Notes: Tom

#2774 - Ross to investigate

#2773 - Have asked reporter for more info #2772 - Adria to write note #2771 - Have asked reporter for PR

General questions:

(amercader) OK Resources for next year: Flask
- yes / no
- if yes: rough plan
Open Knowledge have funding for development on CKAN from a European project. What should the money be spent on? Roughly 50 days worth of work available.
- Moving to flask is probably too large a goal for 50 days but can do parts of it
- controllers
- routing
- middleware
- g & c
- want emphasis on ckan backwards compatibility rather than flask conventions
https://github.com/ckan/ckan/compare/flask-poc
- try deleting pylons, write a shim pylons to provide everything
- put config into plugins.toolkit
- minimize breakages as possible, but some extensions / extension points will break
- therefore this will be ckan 2.x, but it can be discussed

Meeting 2015-12-03

Chair: Notes:

#1234 - Resolution

#1234 - Resolution

General questions:

Python 2.6 support - can it be dropped? Python 2.7 can be installed on CENTOS/RHEL. (Ross).

Drop it on CKAN 2.6, announce when 2.5 is out
sec issues
org changes at OKF
- sebastian moleski new at OKF
- okf is splitting off services (incl ckan) from okf. recruiting 2 full time ckan devs in berlin. will be announced monday. more ckan developers & support of core ckan. continue to contribute openly - open source company.
- will be owned by OKF
- sebastian will be ceo - viderum
2.5 release
- outstanding PRs: https://github.com/ckan/ckan/milestones/CKAN%202.5
- deb packages https://github.com/ckan/ckan-packaging http://packaging.ckan.org/build/python-ckan_2.5.0-trustybeta1_amd64.deb

Meeting 2015-12-01

Chair: Notes:

#2764 - merged
#2757 - amercader

#1234 - Resolution

General questions:

Meeting 2015-11-26

Chair: Notes:

#1234 - Resolution

none

General questions:

Item (name)

Meeting 2015-11-24

Chair: amercader Notes: wardi

#2752 - dread
#2753 - merge? might need to change to a safer encoding if this fails on utf-8 in the future
#2751 - wardi
#2750 - remove noise instead
#2749 - amercader
#2748 - wardi
#2747 - merged

#2754 - amercader
#2745 - amercader
#2744 - wardi

General questions:

moving ckanext-scheming & fluent to ckan org in github - adria +1 dread +1 wardi +1
archiver & qa merge (dread)

https://github.com/ckan/ckanext-archiver

https://github.com/ckan/ckanext-qa

dread to write blog post
release branch? (dread)

https://github.com/ckan/ckan/milestones/CKAN%202.5

adria happy

Meeting 2015-11-19

Chair: dread Notes: wardi

#2743 - dread
#2742 - amercader
#2739 - wardi

#1234 - Resolution

General questions:

Can we backport https://github.com/ckan/ckan/issues/2494 (ross) - answer no, it's a feature
Should we integrate ckanext-scheming into core ckan? (ross) Ian says it is not as flexible as IDatasetForm, so not yet. Will work on it. Worth moving it to the ckan github organization
Adding info to the package_dict (dread) Options:
- IDatasetForm after_show - a la harvester https://github.com/ckan/ckanext-harvest/blob/master/ckanext/harvest/plugin.py#L79 -> Work on this
- IDatasetForm show_package_schema/update_package_schema
  - but what if your site extension also has IDatasetForm too? use is_fallback()
  - how can multiple extensions add this info - harvester, archiver, qa, packagezip
- new extension point that adds to schema
release branch? (dread)

https://github.com/ckan/ckan/milestones/CKAN%202.5
- decided to branch tomororw - dread

Meeting 2015-11-17

Chair: dread Notes:

#1651 - trusty support:

python-ckan_2.3_amd64.deb >> python-ckan_2.3-precise_amd64.deb

python-ckan_2.3-trusty_amd64.deb

#1234 - Resolution

General questions:

Euro portal http://www.europeandataportal.eu/data/
- not open sourcing extensions
- Lang fields: http://www.europeandataportal.eu/data/api/action/package_show?id=2493faf7-2a38-428d-9c19-ba35028900f1

Meeting 2015-11-12

Chair: dread Notes:

Pull Requests (53 open)

#2729 - wardi

Issues (284 open)

#2728 - joet

General questions:

Item (name)

Meeting 2015-11-10

Chair: Notes:

#1234 - Resolution

#1234 - Resolution

General questions:

Merge DGU forks of archiver and QA (dread)
- https://github.com/ckan/ckanext-archiver/pull/15
- https://github.com/ckan/ckanext-qa/pull/24
- adria v happy with the merge, just tag before the merge.
release branch? (dread)

https://github.com/ckan/ckan/milestones/CKAN%202.5
harvester (dread)

adria says: not this week

Meeting 2015-11-05

Chair: amercader Notes:

none

#2724 amercader
#2723 amercader
#2722 amercader
#2721 amercader

General questions:

harvest fail emails (dread)
- https://github.com/ckan/ckanext-harvest/issues/185
- generally useful. optional.
release branch? (dread)

https://github.com/ckan/ckan/milestones/CKAN%202.5

Meeting 2015-11-03

Chair: Notes:

no new PRs #2570 (fixes #2564 and #2562)
RQ discussion

#1234 - Resolution https://github.com/ckan/ckan/issues/2678

General questions:

Harvester improvements (dread)
- https://github.com/ckan/ckanext-harvest/pulls
datapackages metadata (wardi)

https://github.com/ckan/ideas-and-roadmap/pull/160
DAT? ross to ask joel if he's bringing the team member along Joel says "It's with RGRP and Waldo".

Meeting 2015-10-29

Chair: Notes:

#1234 - Resolution

#1234 - Resolution

General questions:

harvest (dread)
Datastorer (dread) - deprecate? https://github.com/ckan/ckanext-datastorer I got confused between this and datapusher
- only useful for ckan 2.1 since 2.2 brings in datapusher
- amercader to add deprecation notice and move to github.com/okfn
CKAN + DataPackages spec (amercader): https://github.com/ckan/ideas-and-roadmap/pull/160

https://github.com/ckan/ideas-and-roadmap/blob/datapackages-spec/specs/datapackages/README.md

https://test.data.gov.uk/dataset/driving-licence-data

http://datapackager.okfn.org/package/sean-s-test-dataset
release branch? (dread) https://github.com/ckan/ckan/milestones/CKAN%202.5

Meeting 2015-10-27

Chair: Notes:

#2711 - dread
#2710 - wardi
#2708 - merged
#2707 - wardi
#2705 - amercader

no new issues

General questions:

Multidistro packaging: https://github.com/ckan/ckan-packaging/pull/6 https://github.com/ckan/ckan-packaging/blob/trusty/README.rst

Meeting 2015-10-22

Chair: amercader Notes:

#2703 - CircleCI merged
#2696 - amercader
#2234 - wardi

wardi to make 2.5 milestone

#2702 -
#2697 - wardi to comment
#2693 - closed

General questions:

Item (name)

Dcat harvester tests: https://github.com/ckan/ckanext-dcat/blob/master/ckanext/dcat/tests/test_harvester.py

Meeting 2015-10-20

Chair: Notes:

#1234 - Resolution

#2234

#1234 - Resolution

General questions:

Dat+CKAN doc (wardi)
Release (dread)
- Ubuntu 14.04 https://github.com/ckan/ckan/issues/1651 (dread) - just a doc change so not important for actual release
- Postgres upgrade https://github.com/ckan/ckan/pull/2670 (dread) - will aim to do it for next week

Meeting 2015-10-15

Chair: amercader Notes:

#2589 - merged
#2685 - ross
#2684 - amercader
#2682 - joet
#2561 - amercader

#2668 - dread
#2667 - dread
#2686 - ross
#2683 - amercader

General questions:

Anyone using Sentry on CKAN? (amercader)
Travis (ross)
(joel) New Jersey went with CKAN - launched this week. Pittsburgh will be CKAN too.
Dat/CKAN (joel)
- Dat now funded by US Open Data
- Joel chatting with Karissa McKelvey - a core dev at Dat
- Dat:
  - designed for big datasets
  - allows different versions of a dataset
    - distributed / not one is canonical
    - collaboration on data
  - and download via diffs
- Karissa has high level design (Google) doc for a ckan extension (https://docs.google.com/document/d/1bYUpQZ_DC7gfr5_DHXv6JK-DvhfFqNP5FKNyl3caIUg/edit#heading=h.fogh5512yqun )
```
  Can't open, says to ask for permission :( Have emailed Joel.  here too, have requested access
```
  - register a ckan dataset
  - possibility of funding from USOD
DGU datastore (dread/ross)
- written a separate datastore, with API web interface and wrapper around postgres
  - not per-resource
  - not inside CKAN executable
  - no private datasets
- also working on improved ETL
  - hand-curated 'manifest' for each dataset, describing the ETL and schema
  - open source Demo: http://apiserver-dev.cloudapp.net/
- needs a name
Q about funding work across several orgs

Meeting 2015-10-13

Chair: amercader Notes:

#1234 - Resolution

#2679 - joet

General questions:

Item (name)

Meeting 2015-10-08

Chair: Notes:

#2675 - rossjones
#2672 - merged
#2671 - wardi

#2678 - amercader
#2676 -

General questions:

Joel will be here Tue/Thu next week to discuss the dat integration

Meeting 2015-10-06

Chair: dread Notes: ross

#2668 - required for i18n of data on edit form. Currently possible before_view, want before_edit too. Ian to update PR with comments.

#2664 dread to dig out DGU hack for resource id changes.
#2660 rating to be removed

General questions:

Dat - resource view (dread/joel)
DGU datastore (ross)

http://apiserver-dev.cloudapp.net/

https://github.com/datagovuk/api_etl/blob/master/manifests/health.yml
Joe suggested he creates some beta .deb packages for 14.04
dread mentioned forking for ckan 2.5 but will wait until end of okf con.

Meeting 2015-10-01

Chair: Notes: wardi

#2668 - bring up at next next meeting
#2663 - joet

#2667 - joet
#2664 - wardi
#2657 - joet

General questions:

Item (name)

Meeting 2015-09-29

Chair: amercader Notes: wardi

#1234 - Resolution
#2647 - export password hashes (wardi)
- set api key as separate PR? (no, still going to include in this PR) (changed mind again, will make separate PR)
- include_apikey, include_email as separate PR

#2655 - amercader

General questions:

Ubuntu 14.04 (amercader)
- tests CI - explore circleci
- packages
Upgrade postgres/postgis (dread)

Meeting 2015-09-24

Chair: dread Notes: wardi

#2654 - dread
#2653 - dread

#2652 - dread

General questions:

https://github.com/ckan/ckanext-harvest/pull/158 (ross) - raise it next week when amercader is here
old issues - happy to close ones saying "closed due to inactivity after 12 months. Reopen if people are still keen to have this fixed." - could add this to http://docs.ckan.org/en/latest/contributing/issues.html
postgres keep original version installed and swap the ports. pg_upgrade script?

Meeting 2015-09-22

Chair: Notes:

#2647 export password hash - joet (to be reviewed by another dev too)
#2639 - wardi

#2649 - wardi
#2650 - wardi
#2651 - wardi

General questions:

Meeting 2015-09-17 - Thursday

Chair: Notes:

2647 - wip, and more discussion needed
2646 - brook
2644 - merged
2638 - ian
2613 - joet

no new

General questions:

Meeting 2015-09-15

Chair: Notes:

#2638 -
#2461 -
#2643 -
#2641 -
#2640 -
#2639 -
#2624 -
#2635 -
#2629 -

#2636
#2632

General questions:

solr schema api (wardi)
2.5 release date estimate (starl3n)
- branch early October
- want to get ubuntu 2.4
- dread to do this release
Interface with Asia-Pac folks (join any time here: http://www.meetup.com/Asia-Pacific-CKAN-Meetup/)
questions asked

https://botbot.me/freeode/ckan/

stackoverflow q's good place to store replies

Meeting 2015-09-10

Chair: dread Notes: ross

Pull Requests (XX open) No pull requests today!

#2625 - package relationships fix We have no UI, but there are legacy tests. Filipe asked if he might consider contributing his UI code.

#1234 - Resolution

General questions:

issue (and perms) https://gitlab.com/ckan/ckan-security/issues/16 - lets convert to a bug and add a validator -Can we go through harvester bugs? https://github.com/ckan/ckanext-harvest/issues
#152 - amercader
#148 - dread
#147 - amercader
#144 - could be better fixed with parameters to search instead, some issues with patch as written
#107 - dread
#85 - amercader, fixed on modern ckans
#67 - joet
#46 - done, closed

-- package_create inside package_create (ian) -anyone ever used angular js with ckan? (joe) any examples? = https://github.com/okfn/ckan.js ?

****************** NOTE: For next meeting, yanik would like to join the meeting - please check if yanik is on IRC.

Meeting 2015-09-08

Chair: Ian Notes:Ross

#2623 - ross
#2622 - ian (to fix code too)
#3570 - wait for 8.4 to be deprecated
#2620 - merged
#2617 - ian
#2616 - ross
#2414 - adria

General questions:

https://github.com/ckan/ckan/tree/flask-poc

Meeting 2015-09-03

Chair: Notes:

#2614 - dread
#2611 - amercader
#2610 - Discussion in ticket (https://github.com/ckan/ckan/pull/2610) https://github.com/ckan/ideas-and-roadmap/blob/64-showcase-spec/specs/showcase/ckan-instances-related-items-survey.md

http://demo.ckan.org/dataset/history/afghanistan-election-data

#2613 - amercader
#2612 - duplicate
#2609 - brook
#2608 - wardi
#2602
- desirable, but would break templates (more details needed)
- discussion on ticket: https://github.com/ckan/ckan/issues/2602#issuecomment-137472753

General questions:

History (dread) - https://github.com/ckan/ckan/pull/2606

Meeting 2015-09-01

Chair: dread Notes: wardi

#2606 history controller removal - dread
#2607 optional related items icon - to ask ross

#2605 (pr 2606) - dread
#2604 upload ux issue - suggest restoring file label + remove button, good for contribution
#2603 - wardi
#2602 - revisit on thursday
#2601 - revisit on thursday

General questions:

Meeting 2015-08-25

Chair: Notes:

#2599 - wardi
#2598 - amercader
#2596 - brook
#2595 - wardi

#2597 - brook
#2594 - amercader
#2592 - wardi
#2591 - amercader
#2590 - brook
#2589 - good for contribution, amercader
#2588 - amercader

General questions:

patch release (amercader)
Multilingual / fluent (amercader)
security pr (wardi)

title": { "en": "Books", "fr": "Livres" }

Backwards compatible API version

"title": "Books" // <-- Or "Livres", depending on ckan.default_locale "title_lang": { "en": "Books", "fr": "Livres" },

New API version wardi +1 amercader -1

title": { "en": "Books" }

Meeting 2015-08-20

Chair: Notes:

#2554 - dread
#2587 - amercader
#2585 - amercader

#1234 - Resolution

General questions:

Item (name)

Meeting 2015-08-18

Chair: Notes:

#2583 - amercader
#2579 - wardi
#2576 - amercader

group_list fun - https://github.com/ckan/ckan/issues/2554#issuecomment-132171669 (amercader)

csrf token approach - https://github.com/ckan/ckan/pull/2359 (brook)

#2581 - wardi
#2578 - wardi
#2577 - amercader
#2575 - amercader
#2574 - amercader

General questions:

fluent approach

-csrf

Regenerate API Key

Meeting 2015-08-13

Chair: Notes:

#1234 - Resolution

#1234 - Resolution

General questions:

https://github.com/ckan/datapusher/pull/80

Meeting 2015-08-11

Chair: Notes:

#2570 - a new command required, more code to be removed
#2572 - amercader
#2571 - IDataPusher plugin is looking good

#1234 - Resolution

General questions - https://github.com/ckan/datapusher/issues/78

  - sec issues, https://gitlab.com/ckan/ckan-security

https://docs.python.org/2/library/imghdr.html

- patch release (amercader) - plan, assign

https://github.com/ckan/ckan/pull/2553

https://github.com/ckan/ckan/issues/2554

Meeting 2015-08-04

Postponed

Meeting 2015-07-30

Chair: dread Notes: brook

#2563 - wardi

#2566 - dread
#2564 - dread (may require #2562)

General questions:

(dread) https://github.com/ckan/ideas-and-roadmap/issues/43
(wardi) two ways of getting absolute urls: url_for uses env vars for host, port, proto; site_url used elsewhere (wardi)

Meeting 2015-07-28

Chair: Notes:

#2560 - ckanext-dcat vs core rdf template - dread

#2559 - amercader
#2557 - amercader
#2556 - wardi
#2555 - dread

General questions:

csrf for post? api with cookie auth? (dread)
- https://gitlab.com/ckan/ckan-security/issues/5
datastore_search (wardi) https://gitlab.com/ckan/ckan-security/issues/12
wardi to create issue on searches using non-writing postgres user

Meeting 2015-07-23

Chair: dread Notes: wardi

Pull Requests (67 open)

#2553 - wrong format detected for tsv, dread
#2551 - amercader
#2505 - wardi
#2548 - joet
..lots of new functional tests from brook and joet
#1105 (wardi)

Issues (266 open)

#2554 - amercader
#2551 - amercader
#2550 - good for contributin

General questions:

datastore_search (wardi) https://gitlab.com/ckan/ckan-security/issues/12
dependencies postgres 8.4->9.4? https://github.com/ckan/ideas-and-roadmap/issues/117 https://wiki.postgresql.org/wiki/Apt dread to create ticket. decide min 9.2 https://github.com/ckan/ckan/issues/2555 14.04 https://github.com/ckan/ckan/pull/2020 https://github.com/ckan/ckan/issues/1651 Travis can't test. CircleCI? - maybe dread can ask Ross to do? requests 2.3->2.7? https://github.com/ckan/ckan/issues/2470 - leave to florian dateutil - joe to upgrade

Meeting 2015-07-21

Chair: adria Notes: dave

Pull Requests (60 open)

none

#2540 - adria

General questions:

Security email https://gitlab.com/ckan/ckan-security/issues/12
Release status
- changelog - dread in progress
- cherry-pick bugfixs
- testing - debian adria, dread to test on beta.ckan.org
- translations - date passed, adria pulled
- patch releases - adria testing packages
- blog post, docs etc - dread

Meeting 2015-07-16

Chair: Notes:

#2536 - release documentation changes, (dread)
#2535 - joet
#2534 -joet

#1234 - Resolution

General questions:

Travis container based:

http://docs.travis-ci.com/user/migrating-from-legacy/?utm_source=legacy-notice&utm_medium=banner&utm_campaign=legacy-upgrade

move to circle ci? seems more mature
2.4 next Wed! (amercader)

Meeting 2015-07-14

Chair: amercader Notes: ward

#2510 - amercader
#2519 - for 2.4,

#2532 - amercader

General questions:

cert issue (wardi) what does cartodb do? wardi to ask on irc
private datastore tables? (wardi) - too expensive, but possible for future if sql across private data needed
datasets without resources (wardi) https://github.com/open-data/ckanext-scheming/pull/58/files

https://github.com/ckan/ckan/pull/2327

Meeting 2015-07-09

Chair: joet Notes: brook

#2529 - joet
#2526 - wardi

#2528
- http://beta.ckan.org/dataset/amtest-data-2-2
- joet to ask for more info
#2527 - wardi
#2525 - wardi

General questions:

Release - any bugs seen or ones to merge into release?
cert

Meeting 2015-07-07

Chair: joet Notes: wardi

#2522 - wardi
#2521 - joet
#2519 - brook
#2518 - joet
#2517 - joet
#2515 - merged by joet
#2510 - brook to add docs and remove from WIP

#2524 - joet
#2514 - wardi to remove old versions on docs when requested
#2514 - brook

General questions:

Item (name)

Meeting 2015-07-02

Chair: wardi Notes: joet

Pull Requests (63 open)

#2510 - iuploader, 2 interafces one for resource uploads one for general file uploads. Downloads can be handleded in IResourcecontroller. wardi - Only allows one plugin of this type, how does this work with dataset types? what happens when you switch plugin types? marked as WIP
#2512 - needs to be backported to 2.4.0 (dread)
#2494 - can we just have someinline javascript to fix the dates? Only occurs in the harvest view that only a sysadmin will see. wardi, seems more complicated than it's worth to store in sessions

Issues (265 open) *

General questions:

release debian package needs testing, another testers would be good. adria will review when he is back monday after next.
security item https://github.com/ckan/ckan/pull/1880

Meeting 2015-06-30

Chair: joet Notes: wardi

#2505 - wip
#2508 - wardi
#2505 - joet
#2500 - stats extension cleanup, joet
#2510 - IUploader

#2511 - joet
#2501 - good for contribution

General questions:

Sec. mailing list issue contact point (brook)

Ian to coordinate
IUploader interface for extensions: https://github.com/ckan/ckan/pull/2510 (brook)

Meeting 2015-06-25

Chair: amercader Notes:

#2485, WIP to merge with licenses in db

#2494 - timezone setting for users/sites
#2493 - amercader
#2492 - dread
resource date field issue "Fields in Additional Info is not updated" thread update resource.last_modified on upload

General questions:

Cloud storage (https://github.com/ckan/ideas-and-roadmap/issues/141) (amercader)
- Direct upload/download ?
- Private resources 2 interface to integrate with providers's security:
  1. get DL token url for redirect for people allowed to download
  2. set file public/private when state changes in ckan

Meeting 2015-06-23

Chair: Joe Notes: wardi

#2487 - joet
2484 - amercader
#2487 - joet
#2485 .. related to #2452 (store licenses in db) frontend testing https://docs.google.com/document/d/1T6doOWweJSYyvoDn9ka0DnbEmBMUSL05ISwZF27upX8/edit

#2490 - recline w/ special chars- brook
#2484 - amercader
#2480 - amercader
#2479 - dread

General questions:

branch today (dread) \o/

Use 2.4.0 https://github.com/ckan/ckan/issues/2439 but brand it "2.4" in the blog post

To release backports too.

current pad: https://pad.okfn.org/p/ckan-release

Meeting 2015-06-18

Chair: joet Notes: wardi

#2461 - ITranslations - wardi
#2477 - joet
#2470 - requirements.txt changes, link to ssl issue, lots of people having problems with requests - joet
#2461 - wardi
#2468 - amercader

#2478 - dread
#2476 - joet
#2475 - joet
#2474 - joet to ask for PR, good for contribution
#2473 - good for contribution
#2472 - add the already entered option to the dropdown, good for contribution.

General questions:

fund infrastructure work https://github.com/ckan/ideas-and-roadmap/issues/152 rough estimates on each item (wardi) and tell Steven

Meeting 2015-06-16

Chair: amercader Notes:

#2467 - multilingual schema, comment on schema version matching ckan version not necessary - amercader 24
#2460 - wardi

#2466 - amercader
#2464 - amercader
#2463 - dup of messytables, bug 2420

General questions:

(dread) Plenty of unassigned issues, particular from when Ross unassigned himself recently: https://github.com/ckan/ckan/issues?q=is%3Aopen+is%3Aissue+no%3Aassignee+sort%3Acreated-desc
More detailed Release plan (amercader): (LIVE version here: https://pad.okfn.org/p/ckan-release ) When in doubt, check here: http://docs.ckan.org/en/latest/contributing/release-process.html (or ask amercader)

23/6 Week 1: Feature freeze {{ 2h }} - Branch release 2.4, update version number - Extract translations, upload to Transifex, announce [1] - Build frontend [2] > Build package 2.4-beta1 [3] > Request testing (package or source install)

From this moment on any changes on the release branch need to be first merged into master and cherry-pick into the release branch. Only bug fixes and docs should be cherry-picked. Unless really necessary no changes that modify the translated strings should be merged. At the same time it would be good to get as many stuff backported to previous release branches as possible, depending on time [4] {{ 2-4h per week per dev }}

30/6 Week 2 - Build frontend [2] > Build package 2.4-beta2 [3] > Request testing (package or source install) - If the branch has changed! {{ 1h }} - Now's a good time to start updating the changelog [5] {{ 3h }}

Keep cherry-picking fixes and docs It's good to test that supported extensions are working against the new release branch. Spatial, harvest, etc are configured to run tests against master so they should be fine. It's worth adding a new Travis condition with the new release branch, eg [6] {{ 1-3h per week per dev }}

7/7 Week 3: A week before release - Build frontend [2] > Build package 2.4-beta3 [3] > Request testing (package or source install) - If the branch has changed! [[1 - Pull translations from Transifex and update the release branch [7] - Announce that release is happening next week on ckan-announce - Changelog should be finished by now

Keep cherry-picking fixes and docs (the closer to release date, the more straight-forward and critical they need to be) {{ 1-3h per week per dev }}

14/7 Release day (or day before) [8] {{ 6h }} - Finalize Changelog - Final frontend build - Update version number, tag - Build final package, upload to http://packaging.ckan.org/ - Upload to pypi - Enable docs on Read the Docs - Announce - Party

[1] http://docs.ckan.org/en/latest/contributing/release-process.html#doing-a-beta-release (Section 6.a-h) [2] paster front-end-build [3] https://github.com/ckan/ckan-packaging [4] https://github.com/ckan/ckan/labels/Backport%20pending [5] https://gist.github.com/amercader/4ec55774b9a625e815bf [6] https://github.com/ckan/ckanext-harvest/blob/master/.travis.yml#L4:L7 [7] http://docs.ckan.org/en/latest/contributing/release-process.html#doing-a-beta-release (Section 6.l) [8] http://docs.ckan.org/en/latest/contributing/release-process.html#doing-a-proper-release

Meeting 2015-06-11

Chair: amercader Notes: wardi

Pull Requests (58 open)

#1234 - Resolution
#2461 - translations with ITranslations, order important, add config setting for extra i18n dirs like extra_public_paths and templates settings
#2209 - packages included with tag_show/vocabulary_show - Ian to finish this off hopefully befoew 2.4

Issues (261 open)

none

General questions:

(wardi) taxonomy editing, scheming the datastore; look at recline editable table

Meeting 2015-06-09

Chair: Ian Notes: adria

#1234 - Resolution

#1234 - Resolution

General questions:

2.4 (amercader) Release Process?

https://github.com/ckan/ckan/milestones/CKAN%202.4 - created new

https://github.com/ckan/ckan/milestones/CKAN%202.4%20%28old%29 - was called 2.4 and renamed - loads of things on there already

today we set a date for branch & feature freeze - 23rd June, aim for release 2 or 3 weeks afterwards

OKF time for core ckan from Monday
thursday meeting time one hour earlier works for amercader (wardi) wardi+1 brook+1 dread+1 amercader+1 agreed - changed to 14.00 UTC
- ckan wiki vs github vs this pad. Adria to update: https://github.com/ckan/ckan/wiki/Dev-Meeting-Notes

Meeting 2015-06-04

Chair: dread Notes: wardi

#2457 - show all orgs not just ones we're admin for in user dashboard, all present happy with default behaviour change - brook
#2455 - api sandbox - extension or core? - wardi to try

#2456 - dread

General questions:

move thursday meeting time? one hour earlier works for amercader (wardi) wardi+1 brook+1 dread+1, bring up again on tuesday Good for Australia too
release schedule? (wardi) no commitment on 2.5 date other than a rough time following the 2.4 release 2.4 to be released when it's ready, branching off in next few weeks
OGC screenshare about CKAN. There is a new spatial JSON format - looks useful for referencing info about a geometry and rendering in a browser. coverageJSON: like geoJSON or topoJSON but got coverage. netcdf to json https://github.com/jllodra/ncdump-json . hopefully posted to ckan-dev soon
Open North data catalog best practices: 1st: https://docs.google.com/a/opennorth.ca/document/d/1OMgK4e0KXkuQwJRS0viEsAqlGFoETDJffG9WQ_ONqdw/edit 2nd: https://docs.google.com/document/d/1kBJIHSFfYOJUZDyQCFir-aFNMQBFbfQD4zB9Sx5mPUg/edit

Meeting 2015-06-02

Chair: amercader Notes:

Pull Requests (63 open)

#2452 - licenses in db, amercader
#2453 - wardi
#2450 - brook
#2449 - amercader
#2429 - dread

#2451 - wardi
#2454 - amercader

General questions:

schemaless solr with repeating and multilingual fields (wardi)
CKANCon wrap-up (wardi)

https://pad.okfn.org/p/ckancon

planning for next ckancon, adjacent to a pycon? sooner than next IODC in Madrid
Link Digital new extensions http://datashades.com/introducing-ckan-galleries-for-images-and-video/ ? (Maybe Alex can talk about this a little, but we'd like to create a screencast to demo it a little later...)
- https://github.com/maxious/ckanext-s3multipart javascript only s3 upload POC
ckan 2.4 (wardi)
- docs cover the mechanics on release
- also merging, cherry-picking, testing
also try package install & patch releases & mounted on non-root url
- do patch releases during next 2 weeks
- then branch for 2.4 and spend 3 weeks getting that out
- everybody with beta/preprod environments should book some time to test under real world conditions
- Adria to check with OKF for resource (Sander)

Meeting 2015-05-26

Chair: amercader Notes: wardi

#1234 - Resolution

#2444 - amercader
#2440 - how do we install reqs? wardi

General questions:

Item (name)

Meeting 2015-05-21

Chair: wardi Notes: wardi

none

#2439 - amercader
#2438 - wardi
#2437 - brook

General questions:

Item (name)

Meeting 2015-05-19

Chair: amercader Notes: wardi

Pull Requests (57 open)

#2436 - fix a couple other similar cases
#2434 - env vars for overriding specific settings - amercader
#2432 - joet

http://demo.ckan.org/dataset?q=&sort=22
#2431 - amercader

#2435 - amercader
#2430 - joet

General questions:

p.implements - inherit=True by default? (amercader)
- the problem is that if we add a new method in an existing ckan interface then an old extension will break
- joe not keen on it - java interface would not come with default methods
- ian suggests we just document in the changelog to deal with the interfacenew method
- dread warns about extensions taking advantage of this won't work with older ckans
- ian suggests ckan should check to see if the function is defined in the extension, so you avoid the breakage, like he did for idatasetform
excel spreadsheet, sheet 3 is default, we should default to sheet 1 and after that allow people to specify the sheet they want somehow. https://github.com/ckan/datapusher/issues/71 (joet) - support multiple sheets?
- joet and wardi want interface for interactive uploading of spreadsheets (it's nice to dream)
- amercader says users just want a simple interface
package_purge adding to actions like group_purge and organization_purge (wardi)
- package_delete should munge the name, undelete should unmunge? - wardi to make an issue for discussion
- sysadmin only?
ckancon
- http://www.eventbrite.com/e/ckancon-2015-tickets-16681567016
- pm https://github.com/ckan/ideas-and-roadmap/issues/146

Meeting 2015-05-14

Chair: joet Notes: wardi

#2428 - merged
#2427 - joet to merge, tell to go look at ckan-docker
#2420 to be fixed in messytables, update requirements instead (datapusher ones)

Issues (249 open)

nope

General questions:

Config in database and env vars (brook)

https://github.com/ckan/ckan/blob/master/ckan/config/environment.py#L344

http://docs.pylonsproject.org/projects/pyramid/en/latest/narr/environment.html#examples
```
choose specific env vars that will override config settings. settings in DB always override settings from env or ini
rename CKAN_DB please!
```
ckancon (dread) (wardi)
multilingual fields, EC approach (wardi) -> dread to push EC for source

Meeting 2015-05-12

Chair: amercader Notes: wardi

Pull Requests (53 open)

#2420 - some people use utf-8 boms send patch to messytables? brook
#2417 - joet

Issues (249 open)

#2426 - IMapper.before_save() not working? datapusher may be using it - dread
#2418 - celery command requires use of postgres - dread to comment use the redis command line client for celery/redis

General questions:

(dread) Meeting tomorrow with Fraunhofer Fokus on pan-EU portal - adria, wardi & morty so far
"Other" CKAN (amercader):

https://github.com/ckan/ckan/issues/2424
Remote CKAN configuration
- Goals:
  - make easier to install CKAN in a cloud env
  - allow sysadmins to change (some) conf options without having to login to the server
  - DB / Solr / (Filestore, mail server...) connection options via env vars "runtime settings"
  - Separate "instance" / "runtime" (more sensitive) settings
    - Define list
    - Mark them
  - Persistent settings ("instance"):
    - Define store (DB?) (https://github.com/ckan/ideas-and-roadmap/issues/88)
  - Separate service defaulting to local CKAN ?
- Separate DB (SQLA level)
  - Store new settings
  - Reset
  - ini file fallback
```
* API for settings 

  - Sysadmins only 

  - set, reset, reset_all 

  - list available options  

  - validation / schemas


* Frontend for updating settings 

  - Defined from extensions ?
```
Show default

Relevant

https://github.com/ckan/ckan/pull/1881

https://github.com/ckan/ckan/pull/1828

https://github.com/boxkite/ckan-multisite, https://github.com/datacats/datacats/pull/82

Meeting 2015-05-05

Chair: David Notes: Adria

#2431 - brook

#1234 - Resolution

General questions:

(adria) plans to release a patch release soon, at least for 2.3, so prioritize backport pulls.

https://github.com/ckan/ckan/labels/Backport%20pending
ckancon2015 (wardi)
- to soon post details of themes, talks etc

Meeting 2015-04-28

Chair: amercader Notes: wardi

#2407 - recpatcha 2.0 - controversial? support both versions? - amercader

#2405 - ckanext-multilingual bug - amercader

General questions:

ckancon update (wardi)
- speakers considered
- dread http://www.slideshare.net/AugustoHerrmannBatis/ckan-overview
- maybe tom rees for round table on deployment - dread to ask
ckanext-dcat work (RDF generation) https://github.com/ckan/ckanext-dcat/pull/28
- Replace core rdf templates?
- ...sidetracked into index based pagination and celery for queues
pan-european data portal (dread)
- ckan ftw; drupal; data quality; comtella(?) proprietary geo vis; Eric? meet to discuss reuse ckancon? paris? wardi needs contact info (or dread may invite?)

Meeting 2015-04-23

Chair: amercader Notes:joet

#2379 - password reset keys, should be backported.

#2404 - suspect they are not using datastore/datapusher and previewing using resource_proxy amecader to suggest they use the datastore instead.
#2403 - we can support translations in javascript - maybe not in recline.

General questions:

introduce: Isaac. Greg.
ckancon2015 (wardi)
- for travel funding need estimate of amount and justification (presenting something?) asap

dcat-ap (dread) - time series items should be distributions or datasets http://data.gov.uk/dataset/highways_agency_planned_roadworks

           - several strong opinions in favour of distributions

       - standard way to find metadata API
       - sparql endpoint
       http://datahub.io/dataset/europeana-sparql

Meeting 2015-04-21

Chair: amercarder Notes: joet

#2393 - amercarder asked davidread to add a test wchih has been done(amercader)
#1903 - are we ok with removing the database tables if they're not used? General agreement that we're happy for them to go, but unsure if it is safe to do so. Needs a indepth review. (amercader)

#2402 - sounds good, pull request please
#2401 - (joet)
#2399 - this page existed? not by design (brook)
#2398 - new end points for atom feeds which are wrappers around package_search, which should be better than the old feeds based off the revisions. Might need some tests to ensure they are working (wardi)
#2395 - needs to check whether this is the case (amecader)
#2394 - wardi: if you change your user name at the same time someone else changes their username to your name, are you logged in as them? (does your cookie with the previous username remain valid?) Is this failing on an auth check with hilarious results? (asking dread to investigate some more).

General questions:

Add new tag to github repo that tracks latest version of each branch. Extension currently install a specific version in their travis-build.sh which is unlikely to change. If we had a new tag 2.3-latest or something +1 for branch name then extensions wouldn't have to worry about updating their travis builds. (joet) joet will create branches.
ckancon2015 rough schedule: (wardi)
- 1 hour ckan intro/demo; changes over the last year
- 8x 15 minute talks on various features + extensions
- lunch
- ckan unconference hangouts on air? funding for core devs to come?

Meeting 2015-04-14

Chair: amercader Notes: wardi

#2393 - dread to add a small test to check that the un customized edit still works
#2391 - joet to review
#2388 - amercader

#2392 - 3stage/2stage bug - wardi
#2390 - mailing list please - amercader
#2389 - brook

General questions:

ckancon 2015 (wardi) https://github.com/ckan/ideas-and-roadmap/issues/120
- hangout/video conference
- unconference, propose topics
- presentation, dev Q+A
- overview, changes this year, broad sales pitch Ira?

Meeting 2015-04-09

Chair: joet Notes: wardi

#2382 - joet
#2200 - joet
#1952 - wardi
#2380 - wardi
#2209 - joet reassigned

no new issues

General questions:

Review CKAN-security posts (amercader) https://gitlab.com/ckan/ckan-security/issues/
circleci (wardi) circleci awesome. wardi might work on support soon. fast tests! ssh access! docker!
ckanext-pages maintainer, joet will review pr and if happy agrees denisz could maintain ckanext-pages

Meeting 2015-04-07

Chair: amercader Notes: wardi

#2384 - joet
#2380 - wip, change to normal param instead of context param

#2387 amercader
#2386 joet
#2385 wardi
#2382 wardi

General questions:

Index draft datasets, and exclude from package_search unless context flag present, similar to ignore_capacity_check? (brook)

proposed implementation: https://github.com/ckan/ckan/compare/master...brew:2376-user_show-package_search

Meeting 2015-04-02

Chair: joet Notes: wardi

#2375 - merged
#2378 - wardi to respond to add helper instead of option to package_show

#1234 - Resolution

General questions:

Item (name)
https://github.com/ckan/ckan/pull/2359 (brook)

include all hidden fields from the (unrelated) parent form, or explicitly add token with data-module-token attribute?
Index draft datasets, and exclude from package_search unless context flag present, similar to ignore_capacity_check? (brook)

proposed implementation: https://github.com/ckan/ckan/compare/master...brew:2376-user_show-package_search

Meeting 2015-03-31

Chair: Ian Notes: Adrià

#2371 show only datasets of type dataset on user_show by default -

Ian: we shouldn't get datasets with user_show at all, different default dataset type, maybe users want other some other core datasets

better to handle this at the IDatasetForm level, a method that says "I don't want to show up in dataset listings"

maybe it can be used to also filter records on the main dataset search page
#2367- merged
#2363 - extensions can add tabs to /ckan-admin - amercader to have a look

#2370 - this stuff should go to [email protected]

General questions:

british summer time confusion. Should we keep utc or move to bst as we have in the past? +1 for utc move thursday 1 hour earlier
https://github.com/ckan/ideas-and-roadmap/issues/10 (joe)

joe proposes to add user extras to core

concern that extras is supposed to hold info that might be modified by the users
http://ckan.org/2015/03/31/ckan-association-steering-group-in-da-house/

Meeting 2015-03-26

Chair: amercader Notes: wardi

Issues (237 open) https://github.com/ckan/datapusher/issues

#2361 - joet
#1105 - joet

#1234 - Resolution

General questions:

Item (name)

Meeting 2015-03-24

Chair: amercader Notes:

#1234 - Resolution

#1234 - Resolution

General questions:

Adding ckan admin tabs for extensions (https://github.com/ckan/ckan/issues/2351) (brook)
- general discussion and suggestions, to be continued on the ticket. To decide on thurs.
Update regarding chat with Rufus about CKAN assoc, tech team and Steering Group Comms, resourcing, etc (amercader)

[email protected]
Config in DB, let's do it! (amercader)

https://github.com/ckan/ideas-and-roadmap/issues/88

https://github.com/opendata/CKAN-Multisite/issues/8
Releases discussion (if necessary?)
docker: what's the deal? ckan-docker, images on docker hub? can they all coexist? (amercader) - from last meeting
- docs are broken wrt docker.

Meeting 2015-03-19

Chair: joet Notes: wardi

Pull Requests (57 open)

#2349 tew_tests -> tests, context['user'] issue https://github.com/wardi/ckan/commit/7510cbf, joet

Issues (236 open)

#2356 - paster create views unauthorized issue, joet

General questions:

https://github.com/ckan/ckan/pull/2354, wardi
Release schedule (dread) - suggest every 3 months. Possible? Wanted? Review release process?

Coolio, so let's ship 2.4 on 4 June. 2.5 on 4 Sept and then 3.0 on 4 Dec. Then 3.1, 3.2, 3.3 and 4.0 on a similar schedule in 2016.
- frequent releases ARE useful
- backports - be ruthless and just support current and previous releases
- Steve mentioned getting marketing materials for upcoming releases
- Steve mentions cost of upgrade - need to apply in advance
- Individual membership (in lieu of paying CKAN Association) is to do with contribution to releases
- discuss more with adria
- what are the overheads/process of translation? Most of us want to want to have more frequent releases but need to hear more about the process from amercader.
- going through the changelog, is this time consuming? could we have the reviewer of PRs adding a line to the changelog? http://docs.ckan.org/en/latest/contributing/release-process.html
docker: what's the deal? ckan-docker, images on docker hub? can they all coexist? (amercader)
- wardi - there is left-over stuff in the repo that need to be fixed and generate an official ckan image, so that datacats, ckan-docker and others can be based on that. get it automatically generated on each commit. wardi to look into that.
- discuss again when adria is here

Meeting 2015-03-17

Chair: dread Notes: wardi

Pull Requests (56 open)

#2352 - make our solr use faster (and use a maintined lib) - amercader
#2340 - revision_id on resource update issue - amercader
#2337 - wardi
#2238 - amercader

Issues (234 open)

#2351 - brook
#2350 - dread
#2347 - amercader
#2346 - joet
#2345 - wardi
#2344 - dread

General questions:

(joe) http://sqltap.inconshreveable.com/ try sqltap if you haven't already - a way to look at db requests
wardi: datacats http://docs.datacats.com/ http://docs.datacats.com/commands.html

Meeting 2015-03-05

Chair: amercader Notes: wardi

#1234 - Resolution Issues (XX open)
#2334 - joet
#2333 - amercader
#2332 - suggest using before_update and set group on dataset - amercader
#2331 - wardi General questions:

https://gitlab.com/ckan/ckan-security/issues

Meeting 2015-03-03

Chair: amercader Notes: wardi

#2330 - add id to form for easier testing, possible issue with id conflict, agreement that adding ids to forms makes sense - brook
#2327 - amercader
#2326 - maybe for 2.3.1 - amercader Issues (XX open)
#2328 - yes, PR please, wardi https://github.com/ckan/datapusher/pulls
#44 - suggest user customize their own configuration
#34 - suggest user customize their own configuration https://github.com/ckan/datapusher/issues
#67 - propose datastore_last_updated resource extra - amercader
#63 - joet
#62 - support req?
#60 - good for contribution General questions:
#2325 - amercader and joet concerned about api breakage for core fields
#2323 - no objections

https://gitlab.com/ckan/ckan-security
- Please create your user
- Review issues
https://gitlab.com/ckan/ckan-security/issues
examples of custom user type in an extension? (brook)
nigelb - I'd like to propose upgrading our JS libs on master. It's running really old versions and plugin authors needing to bundle their own versions is just painful, especially for jquery and the likes. (if this wasn't decided already)

Meeting 2015-02-27

Only Joe, Greg and Adrià on the call New issues To discuss deferred until Tuesday Greg tells us about http://catalogue.data.gov.bc.ca, they are using uwsgi + nginx and are really happy. They are happy to share their configuration.

Meeting 2015-02-24

Chair: Adria Notes: George

#1234 - Resolution
#2311 - assigned to Adria (WIP)
#2297 - assigned to Joe
#2316 - Matthew to continue work on this - marked as WIP for the moment
#2315 - Matthew to change PR to just fixing the docs
#2314 - Assigned to Adria

Discuss:

https://github.com/ckan/ckan/pull/2234

#1234 - Resolution
#2317 - Adria to reply to say - yes go ahead and submit pr
#2309 - Adria
#2307 - Adria confirmed this one - assigned to Ian
#2306 - no reproducing case. Joe assigned General questions:

nigelb - I'd like to propose upgrading our JS libs on master. It's running really old versions and plugin authors needing to bundle their own versions is just painful, especially for jquery and the likes.
joet - (discuss) when calling actions from extensions use 'get_action('package_show')(data_dict=data_dict). get_action will autopopulate the context with default values so you don't need to. This will allow us to rejig context (eventually). Additionally if we get people to explicity specify data_dict, we could perhaps expand the parameters in the future and use it as **kwargs. Shall I add this recommendation to the 'writing extension' docs?
joet - (discuss) if you are writing any models in the extension classmethods of models should be YourModel.your_method(cls, ..., session=model.Session). So that we pass the session from the context of the action function instead of using model.Session directly in the models.
matt: Relating to: https://github.com/ckan/ideas-and-roadmap/issues/7 - I am doing some work on view persistance and wanted to get some feedback on what the framework for improvements is - where to extend, are there any goals for core CKAN, etc.

Meeting 2015-02-19

Chair: amercader Notes: joet

#2303 joe
#2302 amercader
#2296 not sure about adding extra field to resource view table, do we want it stored on another table with a list of resource views, with a button only accessible to sysadmins to 'make featured'? Is there an easy way of implementing of this and easy for user to use? Good luck dennis :p adria: do not use the model in controllers, should use action function to get a list of resource views. Change the name of 'featured' maybe word is too overloaded, also don't like additional field on tables as this feels wrong generally. brook: What is the best way to define the interface of 'what resource views are selected to be featured?'. Perhaps provide example layout to show the how to add a resource view to the homepage layout, but not actually include it. Which ever resource view people want to show is really site specific. Providing user with the tools to select a resource view is more useful than having a thing in core that lets them use the resource view on the table. assigned to wardi Issues (XX open)
#2304- agreed (good for contribution unless it's super simple)
#2297 - recline, (amercader will force it onto someone later)
#2294 - auth only handled by cookie, not way to invalidate on the server once a user has logged out. If someone could get a hold of that session cookie they could pretend to be that user. Couple of new things in 2.3 which help. Can we invalidate the session on the server side? The amount of work to fix this isn't really justified in comparison to updating the docs and letting people know what the repoze.who settings are (brook) General questions:

wtf paster db init in travis build why does the travis god only hate me? (joet) no, travis hates us all
PRs in extensions (amercader)
- https://github.com/ckan/datapusher/pulls do we start to include the datapusher issues in the dev meetings? Probably should do. For other extensions we should try to recruit other maintainers, but realistically, one of us will probably have to keep an eye on them
- https://github.com/ckan/ckanext-googleanalytics/pull/13
GSOC - probably not realistic for this year, we can keep the current stuff done and make it planning for next year

Meeting 2015-02-17

Chair: adria Notes: brook

#2289 - adria
#2287 - adria
#2002 - Ian
#2016 - adria

Discuss:

https://github.com/ckan/ckan/pull/2159 - Ian to review

https://github.com/ckan/ckan/pull/2270 - dread to review

https://github.com/ckan/ckan/pull/2182 - Ian to ask for small test

https://github.com/ckan/ckan/pull/1886 - dread to add example for vocab search. adria to do more advanced search page (#2292).

#2291 - joet
#2282 - ian

Discuss:

https://github.com/ckan/ckan/issues/2260

(https://github.com/ckan/ckan/blob/master/ckan/lib/helpers.py#L78)

General questions:

AM 2.3 retrospective - adria requests participation in retrospective
DR http://docs.ckan.org/en/latest/api/index.html#making-an-api-request - add ckanapi example? suggest python - ckanapi & urllib2, or other - curl. DR to create an issue and contribute
AM private repo - various options discussed, adria to investigate further
2.3 - give one more week for translations and final testing. then another week for freeze. so release in 2 weeks.

Meeting 2015-02-12

Chair: Adria Notes: Joe

#1234 - Resolution Issues (XX open)
#1234 - Resolution General questions:

private repo

Meeting 2015-02-10

Chair: dread Notes: wardi

#2273 - do not provide email by default - wardi
#2270 - move pdf view to separate extension - dread
#2262 - memory issues, responses held longer than needed, needs more testing, ask alice if it fixes problem - wardi Issues (XX open)
#2277 - dread
#2276 - point to ckan docker repo - dread
#2272 - fix docs - morty
#2271 - good for contribution - amercader
#2260 - redirect on login issue, check for open redirect - amercader General questions:

2.3 release (dread). the stuff left is on the label 2.3. Last big one: #2204. And some docs.

Meeting 2015-02-05

Chair: Ian Notes: Brook

#2268 assigned to Ian
#2266 assigned to Joe Issues (XX open)
#2267 assigned to brook
#2264 assigned to adrià
#2263 assigned to ian General questions:

Item (name)

Meeting 2015-02-03

Chair: adria Notes: george

Pull Requests (60 open)

#1234 - Resolution #2256 - assigned to Adria #2257 - assigned to Brook #2258 - assigned to Joe Issues (222 open)
#1234 - Resolution #2261 - Assigned to Ian but will need to be discussed further #2260 - Assigned to Adria but George may follow up on it #2255 - Assigned to Adria General questions:

None

Meeting 2015-01-29

Chair: adria Notes: wardi

Pull Requests (63 open)

#2254 - wardi
#2253 - adria
#2250 - adria
#2245 - david
#2247 - david
#2246 - david
#2248 - allow removing owner_orgs form datasets and allow changing orgs from the form - david
#2244 - adria Issues (223 open)
#2252 - adria
#2249 - self-signed certs and requests, can use environment var - ross General questions:

Item (name)

Meeting 2015-01-27

Chair: ian Notes: adria

#2243 - docs, direct import in action (sean)
#2242 - small resource view fixes (joe)
#2231 - pfd viewer (amercader)
#2235 - ross
#2227 - wardi
#2229 - autocomplete encoding (amercader)
#2221 - rename old test folder (wardi)
#2214 - harmonize grop_show, group_list output (wardi)
#2209 - joe

#2240 - revision id not set when updating an extra: revision_id referst to the extra wardi to suggest using metadata_modified
#2239: wardi: problems with bigints? ross to keep an eye
#2238 - amercader
#2234 - ross
#2232 - connection pool, -dread to look at it
#2230 - amercader
#2228 - wardi
#2224 - amercader

General questions:

Datapusher (ross).
Thoughts on release testing: involving the community, provide a script, etc (amercader)
- general support for this
- am says
Release 2.3 (dread)

Meeting 2015-01-20

No-one else turned up - just dread

Meeting 2015-01-15

Chair: adria Notes: ian

#2221 - test/legacy? - ian
#2217 - david

Issues (215 open)

#2218 - brook
#2216 - david
2211 - ian to comment

General questions:

reported memory leak issue: threads hold on to the memory they used for the last request they handled, so memory usage may expand up do (request size) * (num threads) may be possible to force deallocation, but would be simpler to reduce threads and rows returned (joe)

Meeting 2015-01-13

Chair: adria Notes: ian

#2209 - WIP, tests need fixing
#2207 - adria
#2208 - adria
#2206 - joe
#2190 - ross
#2200 - ross
#2198 - ian
#2191 - joe Issues ( open)
#2210 - ross, maybe add return_id_only too?
#2205 - adria, docs
#2204 - adria, custom filter for choosing resources to add resource views
#2203 - ross
#2201 - david
#2197 - brook
#2196 - ross, duplicate n3 issue
#2193 - adria, upgrade bundled PDF.js
#2189 - joe
#2188 - ross
#2184 - brook, ask for pr
#2186 - ross General questions:

Item (name)
https://github.com/ckan/ckanext-pages/pull/17 WYSIWYG editor for ckanext-pages, joe to review

Meeting 2015-01-08

Deferred, only two developers present Chair: Notes:

Pull Requests (52 open)

#1234 - Resolution Issues (212 open)
#1234 - Resolution General questions:

Item (name)
2.3 update? (Ross)
https://github.com/ckan/ckanext-pages/pull/17 WYSIWYG editor for ckanext-pages

Meeting 2015-01-06

Chair: david Notes: ian

#1852 - reviewed by ian, joe to do second review
#2182 - sean
#2181 - ian
#2179 - ross
#2176 - ian
#2174 - sean Issues (XX open)
#2184 - factory boy issue, upgrade? remove factory boy?
#2164 - change default permissions - david
#2161 - multilingual solr schema needs update - ross
#2158 - ian
#2156 - will comment that this change may be a lot of work
#2155 - nigel General questions:

https://github.com/ckan/ideas-and-roadmap/issues/118 (Ross)
2.3 update? (Ross)
ckan service provider (George) Apologies... I’ve not made it to a meeting for a little while due to some work-related circumstances but I expect to be back very soon
ckan extension team? ********************************************************************* 2014

Meeting 2014-12-18

Chair: amercader Notes: wardi

#2153 - ross (he merged the previous change)
#2151 - https://github.com/ckan/ckan/blob/master/ckan/new_tests/logic/test_conversion.py - amercader
#2159 - seanh
#2148 - wardi
- https://github.com/ckan/ckan/pull/1852

Issues (198 open)

#2150 - amercader
#2147 - wardi
- everyone happy with https://github.com/ckan/ckan/issues/2140#issuecomment-67309881 (amercader)

General questions:

2.3 udpate https://trello.com/b/bdVlMo18/ckan-2-3-release
turn off packages in tag_show too (now that user_show's default has changed)?
"this dataset has changed since you edited it"

Meeting 2014-12-16

Chair: David Read Notes: ian

#2145 - datapusher error messages - adria
#2144 - ian
#2141 - ross
#2133 - david 2.3:

https://github.com/ckan/ckan/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22CKAN+2.3%22

https://github.com/ckan/ckan/pull/1105 - no objections to removing tracking info from package_show (as long as it is still indexed) Issues (XX open)

#2142 - closed General questions:

https://github.com/ckan/datapusher/issues/58 (Ross) https://github.com/pulls?q=is%3Aopen+is%3Apr+user%3Ackan+sort%3Aupdated-desc+-repo%3Ackan%2Fckan+

Meeting 2014-12-11

Chair: adria Notes: brook

#2137 - adria (brook to review)
#2139 - adria
#2135 - ian
#2134 - ian
#2129 - adria Issues (XX open)
#2040 - to discuss with brook (assigned to brook)
#2138 - adria
#2131 & 2130 - ross General questions:

Angelos summarises ckan extensions for metadata schemas
- integrate with pycsw, more closely than on data.gov
- allows defining different metadata schemas using zope interface
- raster and vector store, integration with Geoserver and Rasdaman
- pipeline: support for mapserver, tiling (mapbox), analytics, ...
- extended workflow
Michail speaks more about the metadata schemas support:
- model class that represents a schema
- maps ckan validation/conversion to zope ones

Meeting 2014-12-09

Chair: Ian Notes: George

#1234 - Resolution
#2118 - assigned to Ian
#2117 - assigned to Ross
#2119 - assigned to Ian
#2118 - new fix for something reported a while back. Assigned to Ian
#2101 - Brook says it's ready for review - assigned to Ian
#1951 - assigned to Ian

Detailed discussion around #1852 - Better handling of default resource views https://github.com/ckan/ckan/pull/1852

Adria says it's ready to start reviewing
Ian will review but would like input from others

#1234 - Resolution
#2126 - assigned to Ian
#2125 - assigne to Ian
#2124 - assigned to brook
#2120 - Adria

General questions:

https://github.com/opendata/CKAN-Multisite/blob/master/Proposal%20Draft.md (Ross)
- Desired changes to CKAN
- comments need to come back to them in a couple days
- Ross says to have a read if you have ten mins spare
http://wiki.1248.io/doku.php?id=hypercat#example_catalogues (Ross)
- Hypercat
- Another way of describing of what's in the catalog
George's permissions (Ross)
- Adria creating an Extensions team, make sure George is added.
Can we do these first? v 2.3 PRs! (☞ﾟヮﾟ)☞ https://github.com/ckan/ckan/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22CKAN+2.3%22 ☜(ﾟヮﾟ☜)
if you have 2.3 things assigned and you don't think you have time, let Adria know

Meeting 2014-12-04

Chair: dread Notes: ian

Pull Requests (52 open)

#2115 - stats plugin fix - dread
#2098 - bad error message - ian
#2114 - mis-aligned nav element css fix - adria
#2113 - manifest missing a file - adria
https://github.com/ckan/ckan/pull/1557 - ian

Issues (192 open)

#2111 - org_autocomplete? - ian
#2110 - add licenses doesn't work as docs say - dread
#2109 - need to be able to reproduce - ian
#1779 - vdm fix/backport issue, dread is on it

General questions: - ssl: https://github.com/ckan/ckan/issues/1773

ian: new: ckanext-repeating (repeating fields), ckanext-scheming presets- allows you to group together: form snippets and validation https://github.com/open-data/ckanext-repeating
2.3 PRs! https://github.com/ckan/ckan/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22CKAN+2.3%22

Meeting 2014-12-2

Chair: adria Notes:

#1234 - Resolution

#1234 - Resolution

General questions:

(dread) Harvester improvements:
- https://github.com/ckan/ckanext-harvest/issues/111 "Run jobs straight away"
- https://github.com/ckan/ckanext-harvest/issues/112 "Catch more errors to avoid limbo states"
(ross)
- https://github.com/ckan/ideas-and-roadmap/issues/16 (User extras) - would it go in if someone did this pre 2.3?
  - use resourceextra-style json field (rather than packageextra)
- What is outstanding for 2.3 that really needs to be fixed?
  - in resourceviews adria is making progress, still to do cli stuff
  - amercader to review issues & PRs flagged 2.3
  - security issue fixes (but can be done post branch)
- The master.ckan.org memory leak.
(joe) will the real package_show please stand up (in extensions) or "can I get a specific version of an action function if multiple plugins override the action" CAll it directly
wardi thursday meeting time change?
(George) CSV Validation discussed csvlint.io, messytables

Meeting 2014-11-25

Chair: david Notes: George

#1234 - Resolution

#2093 - Ian assigns himself #2092 - assigned to David #2088 - assigned to David (work in progress) #2086 - David #2083 - will revisit next meeting #2084 - David #2079 - Sean #2077 - Sean #2041 - Joe #2058 - Joe #2034 - Ross #2065 - David #1105 - unassigned - Ross to check on

#1234 - Resolution #2091 - David #2090 - Good for contribution #2089 - Ross #2087 - David #2085 - assigned to Ian #2082 - Ian #2081 - will be moved to Datapusher #2080 - Ross #2078 - Adria #2074 - moved to Ideas/Roadmap #2072 - David

General questions:

Item (name) Any interest in major changes for CKAN 2.3? (David)
discussions around Flask and Django (mostly Django)
- implications for ORM
- flask would be easier, Django would be a rewrite

Meeting 2014-11-20

Chair: adria Notes: ian

#2073 - celery related failure on multiple test runs, adria
#2071 - old rating code, move to models?
#2066 - david
#2069 - adria
#2067 - (merged)
#2064 - adria
#2065 - david
#2062 - david
#2060 - adria
#2059 - adria
PRs ian would like considered for 2.3: #2034, #2003

Issues (187 open)

#2057 - long file names/datapusher issue, good for contribution

General questions:

review PRs and issues ckan-org wide? (ian)
- https://github.com/pulls?q=is%3Aopen+is%3Apr+user%3Ackan+sort%3Aupdated-desc
- https://github.com/issues?user=ckan
adria suggested https://github.com/pulls?q=is%3Aopen+is%3Apr+user%3Ackan+sort%3Aupdated-desc+-repo%3Ackan%2Fckan+

Meeting 2014-11-18

Chair: joe Notes: adrià

Pull Requests (51 open)

#2055 - david
#2052 - depends on #2050 - adrià
#2051 - need more clarity, points to 2.2.1
#2049 - won't merge, we won't remove the call> update #1557 - adrià
#2041 - keep dashes. make it idemptwhatever

#2053 - nice diagram from wardi
ross' avatar is too pale

Discuss:

https://github.com/ckan/ckan/issues/2029 Possible approaches? (amercader)
https://github.com/ckan/ckan/pull/2006 (Remove moderated edits) - can we merge now instead of waiting for 2.4? (dread) Let's merge now and keep an eye for potential issues. Adrià to have a quick look
https://github.com/ckan/ideas-and-roadmap/issues/103 Vocabulary/taxonomy improvements - (dread/ross)
new security issues (dread)
- https://github.com/ckan/ckan-security/issues/4 - david
- https://github.com/ckan/ckan-security/issues/3
https://github.com/ckan/ckan/issues/1779 (amercader)
https://github.com/ckan/ckan/pull/2050 (brook) - ian to have another look
review PRs and issues ckan-org wide?
- https://github.com/pulls?q=is%3Aopen+is%3Apr+user%3Ackan+sort%3Aupdated-desc
- https://github.com/issues?user=ckan

General questions:

Item (name)

Meeting 2014-11-13

Chair: ian Notes: dread

#2034 don't need to look at as sean is looking at it
#2048 assigned to adria
#2047 assigned to joe
#2045 assigned to ian
#2041 WIP

#2046 joe

General questions:

Removing moderated edits https://github.com/ckan/ckan/pull/2006 (dread) yes Ian will review, but will only be merged after the 2.3 branch, discuss next meeting with adria
Secure cookie default (repoze.who) (Brook) https://github.com/ckan/ckan/issues/1942 Ian is keen that the http-only flag can be set by default (although the https only
Welcome Greg Lawrence - Victoria, BC Canada. about to launch production site. interested in geospatial stuff, CSW.

Meeting 2014-11-11

Chair: ian Notes: george

#2034 - Ian still working on... Sean to review #2035 - Ian will review #2041 - Will remain unassigned. Anyone should add comment to issue if they have any. Will discuss again on thursday #1905 - Task failing. Assigned to Adria and he will comment on how to fix test failure

#2044 - Adria to look at #2043 - will move to ideas repos #2042 - to be marked as good for contribution #2039 - ideas and repos #2040 - will wait for pull request for this #2037 - leave assigned to Adria

General questions: - https://github.com/ckan/ckanapi-exporter (seanh) Sean demoed CKAN API exporter. Ian mentioned that he's working on something related that tries to tackle the lossless json<->csv conversion: https://github.com/wardi/jsonsquared

Meeting 2014-11-06

Chair: Adria Notes:

#1234 - Resolution

#1234 - Resolution

General questions:

welcome Vincenzo - just started on CKAN. Interested in harvesting. Italy. European project with company http://www.eng.it/
- suggests adding to the docs an intro to programming ckan. saying read up on pylons first.
Recline.js in ckan (brook) https://github.com/ckan/ckan/issues/1856
- Adria suggests we try the latest version of recline and seeing if it basically works. do basic manual testing with data in the datastore.
(adrià) DAE know why this is like this? https://github.com/ckan/ckan/blob/master/ckan/logic/auth/create.py#L72 Can we use package_update as it seems the logical option (as resource_update does https://github.com/ckan/ckan/blob/master/ckan/logic/auth/update.py#L55 )
ckan security create pr to main ckan repo? Yes since it is only an issue on master, not any releases.
https://github.com/ckan/ckan/issues/2017 leave for 2.4? Yes
(Ian) https://github.com/ckan/ckan/issues/2008

Meeting 2014-11-04

Chair: dread Notes: adrià

Pull Requests (49 open)

#1763 - brook
#2028 - brook
#2027 - ross
#2015 - adrià

Issues (191 open)

#2029 - sean
#2026 - adrià Discuss: https://github.com/ckan/ckan/issues/1820 ian: good to try to support unicode file names

General questions:

Welcome George Sattler - working on Australia portals

Meeting 2014-10-30

Chair: adria Notes: ian

Pull Requests (50 open)

#2024 - adria
#2023 - adria
#2021 [wip] assigned to ross
#2016 - sean
#2015 - change default to not expire
#2010 - adria

Issues (197 open)

#2017 - joe
#2012 - ross
#2011 - adria
#2008 - ian
#2007 - ross assigned, adria to offer assist

General questions:

ideas #77

Meeting 2014-10-28

Chair: sean Notes: ian

Update - RP

http://extensions.ckan.org/ is now operational
https://github.com/ckan/extensions.ckan.org
Missing instructions how to add info but should be there soon
Please add issues.

#2006 - sort-of-WIP, needs review - adria
#1443 - unassigned for now (2.3 backlog)
#2000 - adria
#2004 - adria
#2005 - fix for travis failure - t
#2003 - sean
(ckan-docker) http://clementmouchet.com/ckan/docker/fig/vagrant/development/deployment/automation/community/2014/10/26/ckan-docker-official.html
#2002 - sean, current PR will break existing sites. remove from form instead?
#1995 - for 2.4, adria
#1999 - adria
#1998 - ian
#1996 - sean

Issues (192 open)

#2001 - ross
#1997 - sean

General questions:

https://github.com/joetsoi/ckanext-jsondatastore

Meeting 2014-10-23

Chair: adria Notes: ian

Today is probably better to use this link: https://github.com/ckan/ckan/pulls?q=is%3Aopen+is%3Apr+no%3Aassignee+no%3Amilestone

#1992 - merged
#1991 - ian will suggest moving docker development to ckan/docker and email lists
#1672 - ian likes trivial fixes
#1396 - adria to merge
#912 - joe
#832 - sean

Issues (190 open)

(no new issues)

General questions:

2.3 planning, issues triaged (not definitive! will reassess eg weekly)
- Homework, check your 2.3 issues and PRs > can you realistically work on those during the next 3-4 weeks? https://github.com/ckan/ckan/issues?q=is%3Aopen+is%3Aissue+milestone%3A%22CKAN+2.3%22+assignee%3Aamercader https://github.com/ckan/ckan/pulls?q=is%3Aopen+milestone%3A%22CKAN+2.3%22+is%3Apr+assignee%3Aamercader
- Unassigned issues https://github.com/ckan/ckan/issues?q=is%3Aopen+is%3Aissue+milestone%3A%22CKAN+2.3%22+no%3Aassignee
Setting milestones when assigning issues, do we need a backlog/future milestone? Danger of issues roting in there Personal view, only actionable issues or good for contribution should be in the repo
Red, green. maroon, fuchsia... styles: do we want to support them? They cause issues like https://github.com/ckan/ckan/issues/1869, one extra thing to test
No using foreign keys against core tables in extensions? http://docs.ckan.org/en/latest/extensions/best-practices.html#don-t-edit-ckan-s-database-tables

http://docs.ckan.org/en/latest/extensions/plugin-interfaces.html#ckan.plugins.interfaces.IDomainObjectModification

Meeting 2014-10-21

Chair: Sean Notes: dread

Pull Requests (44 open)

655 john
1987 sean
1985 dread
1983 amercader

Issues (244 open)

1988 sean
1982 amercader

General questions:

(Brook) Coding standards query - refering to issue numbers from PR commits when no issue exists (http://docs.ckan.org/en/latest/contributing/commit-messages.html#writing-commit-messages)
- create an issue
- suggest use 'hub' to convert an issue to a PR
- toby has a script
- general discussion about commit messages with the issue number VS writing a good message. decided to stick with issue number AND encourage good message
(Adam) Do we change ckan-dev to not allow html email / strip images (in sigs, in-line)
- adam concerned about easyness of replying, it is a messy thing to do
- others think it is helpful for lowest ability users to be able to send a screenshot - that might be all you get
- general feeling to discourage but not disallow

Meeting 2014-10-16

Chair: adria Notes:

Pull Requests (40 open)

#1234 - Resolution

Issues (254 open)

#1980 - adria to respond
#1979 - ian to respond

General questions:

Alice Heaton asked on #1851 if there is anything they can do to help get #1792 merged (ian)
- adria will assign to himself and speak with alice
security issues https://github.com/ckan/ckan-security/issues
New backport labels: 2.0.0, 2.1.4, 2.2.2
2.3 (adria)
Showcase spec on github pull request: https://github.com/ckan/ideas-and-roadmap/pull/93 (brook)

Meeting 2014-10-14

Chair: adria Notes: ian

Pull Requests (41 open)

#1978 - joe to review today
#1974 - sean
#1967 - ian
#1973 - sean
#1972 - sean
#1971 - ian
#1968 - adria

Issues (254 open)

#1977 - sean to request contribuition from reporter
#1976 - we should crash earlier if the necessary config setting is missing, sean
#1970 - ian
#1969 - vitor
#1966 - ian

General questions:

(Brook) Showcase discussion
- Current spec doc: https://docs.google.com/a/okfn.org/document/d/19M9LUvEIRbsoxNH0fodolbzQy_7rSUkGUh2S63zbT5M/edit?usp=sharing make public?
(wardi) GIS stories: harvesing, previews in data.gov. data.gov.uk
- http://docs.ckan.org/projects/ckanext-spatial/en/latest/spatial-search.html
(wardi) deprecate, retire the org info from package_show?
deadoralive https://github.com/ckan/ckanext-deadoralive https://github.com/ckan/deadoralive http://seanh.cc/posts/ckanext-deadoralive/ http://seanh.cc/posts/background-tasks-as-simple-web-services/

Meeting 2014-10-09

Chair: ian Notes: Dread

Pull Requests (36 open)

#1965 - ian
#1962 - joe

Issues (249 open)

#1963 - vitor
#1964 - vitor
#1961 - joe
#1959 - sean

General questions:

(Brook) Related Items (Showcase) extension
- Background and spec here: https://github.com/ckan/ckan/wiki/Spec:-Related-Items and https://github.com/ckan/ideas-and-roadmap/issues/64
- New ckan repo here: https://github.com/ckan/ckanext-showcase
- Example: http://data.sa.gov.au/dataset/lost-adelaide-architecture-photographs
- Talking about using IGroupForm todo:
  - relate an item to multiple datasets
  - add fields and an image to an item
  - make an item a first-order object with own page and link from that to the dataset(s)
  - more searchable
  - promotion - publishers can promote best related items on the dataset page and site owners can pick ones for the home page

Meeting 2014-10-07

Chair: David Notes: Adrià

Pull Requests (36 open)

#1958 - Brook's first! sean

#1956 - Improve ckanext templates, joe to look into it
#1817

#1957 - Docker, Ian to look into it

General questions:

Patch releases, announce tomorrow, out next Wed, please test http://beta.ckan.org/ (amercader)
wardi: docker docs
- Is someone working on Docker? If so share your comments
- sean: flag it as beta things missing: run tests, install extensions, upgrade your site, paster commands, working as a dev environment sean: can we have a single dcoker setup for dev and prod? wardi thinks they will look quite different what problem is docker solving? - one-line deployment? better development environment? easier mulittenant hosting? reliable testing?
(dread) http://www.shippable.com/ - Travis replacement using Docker
(joe) python 2.7/drop postgres 8.4? or were we all in agreement on irc?
- drop python 2.6?
- RH6 supports 2.6 until 2020. RH7 has py2.7 & pg9.
- better to drop postgres 8.x - amercader implications for the datastore - datastore runs in 'legacy' mode - you can't run sql queries. some workarounds in pg8. perhaps start using http://pythonhosted.org/six/ ?

Meeting 2014-10-02

Chair: Joe Notes:

Pull Requests (41 open)

#1234 - Resolution

Issues (245 open)

#1234 - Resolution

General questions:

welcome Brook
Release 2.3 (dread)
- main thing is resource views - unstable. some bugs. lost features compared with previous version https://github.com/ckan/ckan/issues/1851 https://github.com/ckan/ckan/issues/1852 https://github.com/ckan/ckan/issues/1955
- couple of important PRs - scheming for Ian, dread sqlalchemy one.
- push to review other PRs

Meeting 2014-09-30

Chair: adria Notes: ross

[Pull Requests]

#1914 rebuild search indexes after tracking update - joet is on the case.
#1953 Don't require a page reload to expand the catalog search filter options [johnm]
- Like it in principle. JohnM will feedback on JS, wardi to feedback on python.
#1952 Add dependencies needed by python requests for SNI support
- Ross to go back and suggest doc change instead.
#1951 Make placeholder images https enabled.
- Looks ok
1948 Backport #291 into 2.0.5 release [adria looking]
#1947 Fix sphinx html build [joet]

[Issues]

#1954 datastore_search_sql with authorization should show private datasets.[ross to feedback on auth problems]
#1803 Get DataStore and DataPusher working in the Docker install
- Redirect to mailing list

[Other]

Release schedule. We don't know when, need guidance from CKAN Assoc on where the resourcing Dev Team Preference is for more frequent point releases and fixed date major releases.

General questions:

release schedule 2.3 still lots of work to finish

Meeting 2014-09-25

Chair: adria Notes: ian

Pull Requests (40 open)

#1947 - spurious travis error?

#1948 - this option should already exist, ian
#1946 - sean

General questions:

https://trello.com/b/kvgOZLMs/ckan-association-roadmap-consultation

Meeting 2014-09-23

Chair: amercader Notes: joet

#1936 - adria to fix tests and assign to sean
#1938 - homepage fix - assigned to adria

#1944 -

General questions:

Security audit, related issues

Meeting 2014-09-18

Chair: adria Notes: ian

Pull Requests (40 open)

#1935 - responsive master, may cause some theme breakage, adria
#1661 - turn off openid by defailt, adria
concerns about supporting gunicorn in 2.3

Issues (237 open)

#1934 - org in package dictize image url wrong, maybe fixed on master? adria

General questions:

Sean: What shall we do with the stats plugin? delete it? enabled by default but not linked in templates. adria will look at hiding datasets appropriately

Meeting 2014-09-16

Chair: adria Notes: ian

Pull Requests:

#1873 - adria
#1929 - ian
#1913, #1925 - joe (no sql injections, thanks)
#1924 - adria
#1878 - adria

Issues:

#1933 - ian
#1932 - adria
#1930 - sean
#1927 - joe to suggest requestor submit fix

General Qquestions:

Sean: What shall we do with the stats plugin?

Meeting 2014-09-11

Chair: adria Notes: ian

Pull Requests (37 open)

#1921 - call package_show from resource_show - joe
#1682 - assigned back to nigel
#1920 - adria
#1919 - adria
#1911 - joe

#1917 - sean
#1914, #1913 - good for contribution, sean
#1907 - joe
#1768 regression in featured org on homepages

General questions:

ian - idataserform customize resource view?

Meeting 2014-09-09

Chair: Sean Notes: Dread

Pull Requests (36 open)

1881 Sean
1886 Dread
1911 Ian
1908 sean

Issues (236 open)

1915 Ian to reply saying won't do it
1914/1913 encourage PR
1912 Ian encourage PR
1910 Sean to say he's confused
1907 general encouragement

General questions:

dread - Harvesting - show provenance, not editing, general rewrite - complicated queues, unclear state machine,
joe - suggest putting alias verb_noun_schemas as noun_verb_schema? (e.g. dataset_show_schema) - sounds good
sean - ckanext-qa https://github.com/datagovuk/ckanext-qa (you need ckanext-archiver & ckanext-report too)
- adding emails address for sysadmins on the report, and ignore one-off breakages
- e.g. http://data.gov.uk/data/report/broken-links
ian - ckanext-fluent https://github.com/open-data/ckanext-fluent is a factoring out of ian's multilingual code, useful for the average multilingual CKAN site. Allows (nearly all) dataset fields to have values in multiple languages. Make it core?

Meeting 2014-09-04

Chair: Notes:

Pull Requests (35 open)

#1612 ian already assigned

Issues (230 open)

#1905 - resource names would be a nice thing to have indexed, good for contribution, joe assigned
#1904 - ian

General questions:

organization_update removes all members if you do not pass 'users'. Can we remove the mis-feature? I don't care if it's backwards incompatible, no one should be using it for user management.. - Should change so that explicitly sending an empty list removes the users, not providing it doesn't change the users.
wardi IValidators/IConverters, do we really need both? wardi feels like it's silly to have both. scheming will need to do both https://github.com/open-data/ckanext-fluent/blob/master/ckantext/fluent/converters.py#L34-L95 . wardi would just get rid of converters and keep only validators. Needs more discussion
nigel: reimplement datapusher in the datastore extension with celery+redis? ian to create idea ticket
sean: disable stats extension on new installs
thursday meetings half an hour later?

Meeting 2014-09-02

Chair: joe Notes: ian

no new PRs

https://github.com/ckan/ideas-and-roadmap

#1903 - authz remove, +1 from joe and ian

General questions:

(dread) Are people happy with me removing the old authz tables in a migration now? i.e. https://github.com/ckan/ckan/issues/1903
wardi IValidators/IConverters, do we really need both? wardi feels like it's silly to have both. scheming will need to do both https://github.com/open-data/ckanext-scheming/blob/multilingual-fields/ckanext/scheming/converters.py#L32-L95 . wardi would just get rid of converters and keep only validators. Needs more discussion

Meeting 2014-08-28

Chair: adria Notes: nigelb

Pull Requests (37 open)

#1899 - assigned to sean
#1900 - assigned to sean
#1898 - assigned to adria
#1894 - assigned to joe
#1443 - almost there, only 20 errors or so that needs fixing. assigned to nigel.

Issues (228 open)

#1902 - will asign to sean at next meeting
#1901 - assigned to nigel
#1896 - closed

General questions:

wardi IValidators/IConverters, do we really need both? wardi feels like it's silly to have both. scheming will need to do both. wardi would just get rid of converters and keep only validators. Needs more discussion
add to ideas from steering group? - https://docs.google.com/a/okfn.org/document/d/1B3NXewTdgCa1uwK6n0f9dHSKTJyzh27NTmzSmLzVEFk/edit
Hello NuCivic folks! Looking to see where NuCivic can help. Any help in ckanext-drupal7 would be very helpful. Recline is also a good place to help. Harvester is also good target since it uses API v2 and not API v3. There's also Good For Contribution bugs.

Meeting 2014-08-26

Chair: adria Notes: nigel

Pull Requests (35 open)

#1894 - sean to take a look. weird test failure
#348 - adria will supervise
#1895 - ian will review
#1893 - nigel to review

Issues (227 open) ZAARO (new) BUGS

General questions:

nigelb - Inviting DKAN folks. Let's open a conversation to fix issues in the time that they will be donating to the association. How does the hours thing work? We'll talk to Aaron and others whe they attend a meeting. We could potentially use the time to work on Recline or resource views which is less python and would be overall helpful to both sides. We'll wait until they can confirm what bits can help both CKAN and DKAN. Nigel to coordinate.
nigelb old PR with broken tests - https://github.com/ckan/ckan/pull/1707
ian - scheming support branch - ian has things to add to the plugin toolkit - separate branch for it? adria says yes
dread - model tables setup on start-up. Use a paster command instead of running it every time the extension is loaded automatically. Automatic makes it easier for users. Documentation on how to use the db extension.
sean - blog extension from sweden - c.f. ckanext-pages
rgrp - informal meeting with streering meeting. Will report about the meeting soon. We need a high-level technical roadmap, no commitment to time, but an idea of what we want to build for feedback from people and see if people want to work on it. Members who sign up could commit to those issues. Ideas from steering group - https://docs.google.com/a/okfn.org/document/d/1B3NXewTdgCa1uwK6n0f9dHSKTJyzh27NTmzSmLzVEFk/edit .Github does not provide the high-level overview. Link item to github ideas repo.
- How does in-kind time work? Will they deicde or will tech team decide. It will be a mix with members because it would easier if it was aligned with their interest.
- To what extend does tech team decide on priority for items on this list? Tech team would have a good input in that regard. In terms of features, users would have more knowledge about features, while tech team would have more knowledge of tech debt. The roadmap will need to be a mix of both.
- Actions from team - Edit/comment on the list in the document
- Description is too brief and items on there would need full description elsewere, preferably ideas repo. This isn't about implementing something, but about facilitating discussion.
- Initial steering group will have data.gov, data.gc.ca, data.gov.uk, and Open Knowlege (shh)
- We need to decide on what needs to go into this list at the next meeting or on Tuesday

Meeting 2014-08-21

Chair: Notes: ian

Pull Requests (34 open)

#1891 - nigel already replied
#348 - .n3 support old pr back from the dead, adria assigned

#1892 - wardi
#1890 - joe
#1889 - nigel

General questions:

ckan install stories
ckan performance moaning

Meeting 2014-08-19

Chair: adria Notes: ian

Pull Requests (x open)

#1888 - improvement to tracking update command, sean to take a look
#1885 - fix org image src link - adria volunteered

Issues (x open)

#1887 - issue fixed by 1888 - sean
#1884 - interesting jealous proxy issues - ian
Please prioritize https://github.com/ckan/ckan/labels/Backport%20pending
What's the status of #1612 (facet limits) What needs to be merged into 2.2.1

General questions:

Should all CRUD action extension points (eg after/before_create/update/delete) pass the same params (context, data_dict) https://github.com/ckan/ckan/pull/1875/files#diff-4a6382e3872769be8829f4e5968cb848R230
silly tag harvesting question.
performance on ML https://lists.okfn.org/pipermail/ckan-dev/2014-August/007991.html

Meeting 2014-08-14

Pull Requests (30 open)

#1883 - adria
#1882 - joe
#1795 - (adria). Wardi had planned more, but there is enough currently to review in a single pull request. Change datasetform now rendered as a snippet, was previously done in the controller. Added deprecatred_lazy_renderer used for old forms/templates in Genshi, allows tests to pass will also jinja2 templates that override package_edit form from controller. Code that prevented access to c object in snippets have been removed as it was implemented confusingly (which we should be avoiding anyway)

Issues (226 open) no new issues!

Apologies: Sean (Singapore)

General questions: https://github.com/ckan/planetckan

We (OKF) talked about wanting a developer blog where devs can post about features etc.
Instead of a blog, why not a "planet" site that pulls in posts from feeds?
Then devs can post to their own blogs, and also get it on the planet automatically..
Also it can be a CKAN thing not an OKF thing.
We can add lots of people and orgs from the community.
Theme it properly, put it at planet.ckan.org, put link in ckan.org header.
We would need a few more blogs for it to get started I think -- too few on there currently.
Also people may want to add CKAN-specific tag or category feeds instead of their main blog feeds.
What do people think?
Sounds good
might need some curation - needs filter by a tag (e.g 'ckan').

Meeting 2014-08-12

Chair: Adria Notes: ian

Pull Requests (28 open)

#1879 - joe to review, backport planned
#1443 - adria
#1841 - WIP
#1877 - adria to merge
#1817 - waiting for vdm release
#1861 - ckan express will be a good test of gunicorn in prod, will wait for results of further testing
#1682 - ian, for backporting too

Issues (227 open)

#1878 - joe needs a number
#1876 - adria
#1874 - resource last updated used by archiver extension, adria

General questions:

security mailing list (dread) - adria suggests we just continue with the ckan committers list
multilingual fields (wardi) - storing languages as a json blob { 'en': blah, 'fr:blah }. Plans to use multilingual solr schema as a guide.
need to link to the right place for security reports

Meeting 2014-08-07

Chair: joet Notes: Dave

no needed assignment

#1874
#182

General questions:

gunicorn gevent - nigel has run into problems. wardi objects. (http://docs.gunicorn.org/en/latest/design.html). We should probably do some more testing with gunicorn.
multilingual fields (wardi) - storing languages as a json blob { 'en': blah, 'fr:blah }. Plans to use multilingual solr schema as a guide. -https://github.com/datagovuk/ckanext-report - we should announce this more widely - dread is this ok? YES!

Meeting 2014-08-05

Chair: David Notes: Joe

Pull Requests (29 open)

#1234 - Resolution
#1871 - (Joe)
#1682 - (wardi)
#1861 - wardi - is gunicorn generally better?(wardi)

Issues (221 open)

#1234 - Resolution
#1870 - (vitor)
#1868 - (joe)
#1866 - (sean)
#1865 - (dread)

General questions:

Item (name)
- CKANcon https://docs.google.com/document/d/12Oj5n1POukUW6Kl7oFRIAXYAAGivExNtOEylD7Dvo5g/edit
- api helper text (from last meeting)
  - get rid of success=True/False too and get rid of the whole envelope? no, keep envelope
  - change it to: 'help': '/api/action/help_show?action=package_show' - added to ticket https://github.com/ckan/ckan/issues/1318
- need to have a list of CKAN consultancies - start a wiki page -> dread to dig out and start - see https://github.com/ckan/ideas-and-roadmap/issues/70

Meeting 2014-07-31

[Pull Requests (29 open)]https://github.com/ckan/ckan/pulls?q=is%3Aopen+is%3Apr+sort%3Aupdated-desc]

#1861 - We'll add comments. We can't drop Apache. Need to support both.

[Issues (221 open)](https://github.com/ckan/ckan/issues?q=is%3Aopen+is%3Aissue]

#1863 - We will update ckan.org to be more consistent with documentation - http://ckan.org/features/#history.

General questions:

Fanstatic's resource.config. Needs docs. Nigel or Sean to pick up the issue.
Datastore SQL search security issue
Help on api calls
- Link to html docs. Cons: We can break the links.
- help_show action returning the docstring.
Updated https://github.com/ckan/ckanext-repo

Meeting 2014-07-29

Chair: Sean
Notes: nigelb

[Pull Requests (33 open)[https://github.com/ckan/ckan/pulls?q=is%3Aopen+is%3Apr+sort%3Aupdated-desc]

#1828 - Assigned to davidread
#1819 - Sean to pick it up tentatively. Waiting for Adria.
#1696 - Assigned to Nigel
#1657 - Joe to close
#1600 - Assigned to Ross

[Issues (220 open)](https://github.com/ckan/ckan/issues?q=is%3Aopen+is%3Aissue

No new issues!

General questions:

dread: ckanext-qa and ckanext-archiver - can we merge in the DGU branch and call it v2. The problem is the OKF version in github/ckan uses the awful TaskStatus and now data.gov have started using it, issuing pull requests and as a community we shouldn't care for two forks. add in a tag for v1. agreed.
nigel: can we shift ckanext-googleanalytics to deprecated and make the DGU fork the main one? It has support for the new google oauth API, which our version doesn't. Mark old one as deprecated. DGU need to add in the templates for ckan 2.
datapusher pull requests! . Nigel to figure out time for working on datapusher
CKAN Association - Nigel to ping adam.

Meeting 2014-07-24

Chair: Vitor Notes: Nigel

Pull Requests (38 open)

#1714 - dread to review
#1792 - not blocked, but still WIP, vitor talk to adria
#1701 - already assigned to joet. dateutil assumes mm/dd/yyyy if ambigous. It may bite someone in the future.

Issues (260 open)

#1858 - assigned to nigel
#1857 - good for contribution
#1856 - vitor to take a look
#1852 - currently the defaultview is hard-coded and needs changing. vitor and adria working on it.
#1849 - vitor to ping johnmartin/sam

General questions:

Datapusher/ckan-service-provider issues/pull requests (nigelb) - agreed to discuss at next dev meeting
full-text search on non-textual fields (vitor) - can't filter for time/year. Only text. vitor will talk to adria.

Meeting 2014-07-15

(no meeting, everyone off at ckancon. kindly and wardi chatted about what's been happening the past few months)

Meeting 2014-07-10

Chair joe Notes ian

Pull Requests (42 open)

#1837 - adria
#1836 - adria
#1792 - depends on resource views, mess of branches to discuss in berlin
#1830 - joe already assigned, not blocked review please (pretty please?)

Issues (260 open)

#1838 - vitor to work on, to talk in general questions

General questions:

allow full text search on specific columns (#1838), related to #1792
make sure datastore user is different than main ckan db user in docs
(dread) Tag Extras https://github.com/ckan/ideas-and-roadmap/issues/68 - look at using json filter index
(dread) DataPusher notification triggered on before_commit - suggest change to after commit

Meeting 2014-07-08

Chair adria Notes ian

Pull Requests ( open)

#1828 env variables for config settings, wip seanh
#1792 wip resource views, to revisit when vitor is at meeting
#1836 exception logging middleware, can we set inherit=True as a default to avoid future interface change breakage? add a prettier error message? adria to investigate
#1732 tests written by submitter - wardi to review
#1826 sphinx test - nigel
#1591 ongoing translation discussions - adria
#1830 multiple datastore values - assigned to joe

Issues ( open)

#1835 docker-test-environment, wardi
#1834 ?
#1833 wardi assigned
#1822 IPackageController docs incomplete, let's remove the deprecated methods, nigel assigned
#1829 ongoing lessc discussion, lesspyc doesn't work for our less files; let's keep using the ppa

General questions:

* CKAN command? (Sean added this but can't make the dev meeting today)
  Really needed to make running commands in the docker container easier.
  Also needed so we can template both the dev/prod and test config files.
  How to implement it?
      (See       Sean's thoughts at the bottom)

Any topic that the tech team wants to raise at CKANCon [ckon!] with the community? https://docs.google.com/a/okfn.org/document/d/12Oj5n1POukUW6Kl7oFRIAXYAAGivExNtOEylD7Dvo5g/edit Sean's thoughts:

Rewrite cli.py with docopt. Don't want to duplicate any of the UI code that defines the commands, sub-commands, options and docstrings. Delete all this and re-write it with docopt. But the code that actually carries out the commands - just keep it as-is but have it called by our new docopt stuff. Most of the non-CKAN paster commands aren't needed, but we will still need paster serve and paster post at least. For these, re-implement their UIs and docs in docopt, duplicating the UI stuff, just wrap them and call paster. paster make-config to be completely replaced by a new ckan make-config that just renders a Jinja2 template, accepting settings from env vars, and can be used to render both the dev/prod config file and the test one. The ckan executable to be installed as a script or console command or whatever in setup.py, so it ends up in the bin dir of the virtualenv. As soon as you activate a virtualenv, you get that CKAN instance's ckan command on your PATH. For the package install, we can make it symlink the ckan_default virtualenv's ckan executable onto the system-wide path so you don't even need to activate the virtualenv. For the source install we can add a command to make the same symlink. So by default you'll get the default CKAN instance's ckan command, but if you have multiple instances installed and activate one of their virtualenvs then you will get that ckan command. For docker we'll use CMD or ENTRY_POINT in the Dockerfile so you can just do docker run serve or maybe docker run ckan serve without typing the full path.
ckanext-scheming is alive #1795
- a vanilla schema: https://github.com/open-data/ckanext-scheming/blob/master/ckanext/scheming/ckan_dataset.json
- setup_template_variables (c. ew) ? add package_type (group_type) to each call?
  - use dataset_type
- how should I allow registering new converters/validators?
  - new interface to allow users to register converters/validators that get_converter/get_validator will return

Meeting 2014-07-03

Chair ian Notes ?

Pull Requests ( open)

#1814 - nigelb
#1591 - amercader already speaking to them
#1826 - joet
#1697 - package patch - discussion continued. wardi arguing with himself. Preferring simpler method wip
#1827 - is a fix for 1720 that is already assigned to nigel
#1824 - related to 1826? joet
#1799 - amercader
#1819 - do we want to allow patch releases of requirements to be automatically updated? Disucssion has a while back, where requirements were pinned
#1530 - passlib - amercader will try to do a 2nd review

Issues ( open)

#1830 - vitor
#1829 - Do we want to move away from nodejs and use a python implementation? - nigelb
#1822 - Already marked as good for contribution - possible backwards incompatilibity issue if they are relying on dataset reprensentation in api v2
#1821 - wardi
#1820 - joet - probably broken for many other unicode characters?
#1816 - amercader

General questions:

* CKAN command? (Sean added this but can't make the dev meeting today)
  Really needed to make running commands in the docker container easier.
  Also needed so we can template both the dev/prod and test config files.
  How to implement it?
  
  Sean's thoughts:

  Rewrite cli.py with docopt. Don't want to duplicate any of the UI code that defines the commands, sub-commands, options and docstrings.
  Delete all this and re-write it with docopt. But the code that actually carries out the commands - just keep it as-is but have it called by our
  new docopt stuff.
  Most of the non-CKAN paster commands aren't needed, but we will still need paster serve and paster post at least. For these, re-implement
  their UIs and docs in docopt, duplicating the UI stuff, just wrap them and call paster.
  paster make-config to be completely replaced by a new ckan make-config that just renders a Jinja2 template, accepting settings from env vars,
  and can be used to render both the dev/prod config file and the test one.
  The ckan executable to be installed as a script or console command or whatever in setup.py, so it ends up in the bin dir of the virtualenv.
  As soon as you activate a virtualenv, you get that CKAN instance's ckan command on your PATH.
  For the package install, we can make it symlink the ckan_default virtualenv's ckan executable onto the system-wide path so you don't even need to activate the virtualenv.
  For the source install we can add a command to make the same symlink.
  So by default you'll get the default CKAN instance's ckan command, but if you have multiple instances installed and activate one of their virtualenvs then you will get that ckan command.
  For docker we'll use CMD or ENTRY_POINT in the Dockerfile so you can just do `docker run serve` or maybe `docker run ckan serve` without typing the full path.

Meeting 2014-07-01

Chair: Adria Notes: ian

Pull Requests (41 open)

#1817 - upgrade sqlalchemy, requires some vdm changes in sqlalchemy-0.9-support branch, dread assigned
#1777 - add api example to docs, better in a source file with a test, sean takes it
#1734 - sean to merge
#1658 - looking for second reviewer, adria busy for next couple weeks.. anyone?
#1725 - joe merged
#1732 - requester to add tests
#1814, #1813 - docker-related nick assigned
#1879 - package_patch: to discuss in general questions
#1799 - sentry middleware, nigel to review; discussion around entry point required for sentry and other similar middleware, current middleware plugin isn't perfect for this case
#1412 - users regenerate api keys, ongoing
docker was merged!
#1798 - sean assigned
#1797 -

Issues (256 open)

#1819, #1816: requests + sqlalchemy version upgrades; nor more requirement upgrades add comments to #1816
#1818 recource_show auth done wrong, sean to respond
#1815, vitor is working on distinct with datastore
(lots of docker issues), #1809 suggests removing old packaging scripts
#1800 issues migrating from old docker to new docker config, issue for dev list?
#1796, celery? ckanext-queue? we need background tasks for a few things. Celery+redis? redis by itself? queues are hard; let's go shopping. Ask open spending about their celery experience https://github.com/okfn/ckanext-queue

extras to discuss:

#1768 organization_list all_fields misses out extras and users
#1796 Changing group name can time out

General Questions

rufus wants commit access to be able to close old PRs himself (raised last meeting)
wardi: package_patch and json-patch APIs https://github.com/ckan/ckan/pull/1679

Meeting 2014-06-26

Chair: ian Notes: joe

#1765
#1659 - still discussing tests
#1793 - Cannot determine why all cookies starting with ckan exists, behaviour seems bad. dread to review
#1755 - dockerfile :-) ping nigel to see if has time soon to review.
#1786 - joet to merge
#1782 - going to be moved to wiki as it seems it will be more useful, issue will be closed, sean will comment
#1725 - to merge subject to minor change re read_url
#1251
#1492

Issues (250 open)

#1796 - assigned to dread for now, discussion to continue
#1794 - leave with vitor for now, joet thought we required this for ckan-pakistan project so it might exist already.
extensions.ckan.org

General Questions

retiring issues- we should cull old issues
rufus wants commit access to be able to close old PRs himself (discuss at next meeting)

Meeting 2014-06-24

Pull Requests (51 open)

#1659 - Almost there, model for new functional tests
#1755 - Docker: docker links for postgres / solr
#1776 - joe assigned
#1786 - nick to look at test failure, joe to review
#1783 - ckan hardware requirements: easy to get out of date, really depends on the number of datasets, other factors, joe to come back to adam

Issues (x open)

#1789: ross to look at it
#1788: expected 404 on deleted thing
#1785: should be possible to only connect to the db / solr when needed,
#1784 amercader to work on it at some point

General Questions

Release 2.2.1 we talked with nigelb about splitting the work, but if someone wants to help here's a list of stuff that needs to be backported. By helping I mean reviewing and writing a comment "this looks good to be backported" or "this might cause issues https://github.com/ckan/ckan/issues?direction=desc&labels=Backport+pending%2CBackport+2.2.1&page=2&sort=created&state=closed https://github.com/ckan/ckan/wiki/Release-branches-tips-and-tricks

Meeting 2014-06-19

Chair: joe Notes: wardi (for a bit at least)

Pull Requests (48 open)

#1686 nigel already assigned
#1734 assuming nigel is still working on it
#1755 nigel to review, possibly others
#1725 joe assigned, nigel to look as well
#1412 joe assigned
#1777 nigel assigned

Issues (244 open)

#1781 unicode in site title issue - will ask for pr, sean assigned
#1780 many ways to get user - wardi assigned
#1779 resources disappearing (we should fix our API for updating resources) - nigel assigned
#1776 datastore empty array failure - assigned to vitor
#1775 owner_org_validator can't be overridden by auth - general agreement that the issue should be fixed, sean assigned and will mentor submitter towards a fix

General questions

wardi: removing 2+year deprecated package form feature https://github.com/ckan/ckan/commit/faa8b296, related to #1659, generally agreed
wardi: adding package type to template for scheming extension. harvester extension needs the same thing; adria says pass it to all the package templates
nigel: ckan on SSL https://github.com/ckan/ckan/issues/1773 need to move an icon

Meeting 2014-06-12

Chair: amercader Notes: nigelb

Pull Requests (55 open)

#1745: Agreed that style (d) works best, though we don't mind style (b). Adria to look.
#1757: Assigned to sean.
#1766: Assigned to nigel.
#1765: Assigned to Ian. We would stick the unvalidated package dict as validated.
#1664: Waiting for tests
#1658: Already assigned to Ian
#/1659: Assigned to vitor.
#1761, #1760, #1759, #1758 - Assigned to sean.

Issues (247 open)

1769: Nigel
#1768: We'll wait for dread to explain.
#1767: Assigned to vitor.
#1764: Related to #1765.
#1763: User-error. Adria will get back to user.

General questions

Road to 2.3 (amercader) What should go into the next stable release (without thinking about time)
- Resource views (#1251) - vitor working on this
- Upgrade requirements
  - SQLAlchemy 0.7 > 0.8 - we can't go further because of vdm.
  - rest: http://requires.io/
- Turn off OpenID (#1661) - joe
- Docker (#1755) - nick
- Ubuntu 14.04 (#1651) - nigel
- #1530] use passlib for passwords / apache log - joe
- Nuke Legacy templates +∞ need to create an issue-> (some) new functional tests -ian
- call_action - open, no issue yet.
- after_/before_action - Needs a bit of discussion
- responsive(?) - nigel to follow up with sam.
- How to avoid a plugin to be loaded? (vitor) - vitor to create an issue explaining the use case
- Validators that convert data as well (vitor)- vitor to create an issue explaining the use case

Meeting 2014-06-10

Chair: adria Notes: ian

Pull Requests (49 open)

#1734 main.debug.css - can we compile these less files with python? node is difficult to install for some users. wardi: compile debug at the same as prod css as part of release?
#1659 - vitor assigned again

Issues (239 open)

#1753 no new_ names, adria: +1, toby: rename new_authz and let things importing it break.
#1752 #1751 example extensions should have the same directory layout as real extensions
#1750 vendor versions not minified (?) assigned to vitor
#1749 good for contribution
#1748 web site problem
#1747 option to allow html in some markdown fields, toby to make PR
#1713 to backport fix to 2.2

General questions

Nigel: responsive branch http://responsive.staging.ckanhosted.com/ responsive changes backported to 2.2, may not be maintained but required for some users https://github.com/ckan/ckan/tree/responsive-2.2 and https://github.com/mintcanary/ckan/tree/responsive present at next community meeting?
Nigel: Post to ckan-announce about critical datapusher bug / new package release. kindly's fix is on master, but not 2.2.
Nigel: ckanext-searchhistory https://github.com/ckan/ckanext-searchhistory In action: http://data.satapps.org/ present at next community meeting?
ian: coding standards import change #1745 rename helpers to template_helpers? to open separate issue

Meeting 2014-06-05

Chair: Dread
Notes: Adrià

Pull Requests (50 open)

https://github.com/ckan/ckan/pull/1744 joe
https://github.com/ckan/ckan/pull/1694 nigel to merge

Issues (236 open)

https://github.com/ckan/ckan/issues/1737 Adrià to look for the old code on archiver that use to / does that and add a comment

General questions

sanitize urls / content

Meeting 2014-06-03

Chair: Ian Notes: dread

Pull Requests (49 open)

https://github.com/ckan/ckan/pull/1740 assigned to joe
https://github.com/ckan/ckan/pull/1736 Making user more explicit for the factory func. Might need more discussion. Ian agrees with it but maybe Adrià should give opinion. Assigned to Adrià. Ian not happy with site user concept - 'creation if not already created' causes unpredictable errors.
https://github.com/ckan/ckan/pull/1739 assigned to dread

Issues (235 open)

https://github.com/ckan/ckan/issues/1741 Don't think the vuln is exploitable without edit permissions. No deliberate DOS events so far. Discussion about python 3, moving off pylons. Ian says hard bit to be joint python 2.7/3.3 compatible is the strings. Point him at move from pylons info. Assigned to wardi.
https://github.com/ckan/ckan/issues/1737 could be difficult -needs a background service to do it - an extension or something else. wardi will point him to roadmap.

Meeting 2014-05-29

Chair: Ian

Notes: Adrià

#1734 sean will look into it
#1727 nigel to answer back or merge it if he is happy

Issues (229 open)

No new issues

General Questions:

sanitize resource urls to solve https://github.com/okfn/ckanext-iati/issues/44
```
  - Amercader to investigate libraries to sanitize urls
```
removing revisions - help may be coming
- Make revisioning optional Includes changing queries to not query Revision tables but the actual table
- Implement history in activites
- Move revision info to activities
- Completely remove them
storing extras in a single row
- https://github.com/GSA/ckanext-geodatagov/blob/master/ckanext/geodatagov/plugins.py#L254
- https://github.com/GSA/ckanext-geodatagov/blob/master/ckanext/geodatagov/plugins.py#L363
- amercader: first link merges them in a single extra, second expands them for showing

--- nigel away, deferred

Nigel: responsive branch http://responsive.staging.ckanhosted.com/
Nigel: Post to ckan-announce about datapusher bug / new package release
Nigel: ckanext-searchhistory https://github.com/ckan/ckanext-searchhistory

Meeting 2014-05-27

Chair: Sean

Notes: Ian

#
#1724 - baseimage docker concerns from sean, vitor has been using docker for ~8 months with no problems
#1731 - resource extras in solr - wardi assigned
#1730 - vitor assigned

Issues (231 open)

#
1733 - adria: nigel said this would be easy for the new filestore, nigel assigned
1729 - need to backport fix from resource-views branch

General Questions:

navl_validate is in toolkit, adria has another use for it
sean: plugin toolkit refactor, all agreed with removing class that replaces module
adriaL check_access_core for plugins overriding access checking to call original check
sean: docker discussion

--- nigel away, deferred

Nigel: responsive branch
Nigel: Post to ckan-announce about datapusher bug / new package release
Nigel: ckanext-searchhistory

Meeting 2014-05-22

Chair: Adria

Notes: Ian

#
#1503 assigned to dread
#1686 docs for recommended use of templates - nigel
#1694 more docs, also nigel
#1727 to add a doc page about deprecated features

Issues (228 open)

#
#1726 docs improvement, good for contribution?
#1725 suggestion for IDatastore interface, how should we allow datastore to be extended?
- cf https://github.com/ckan/ideas-and-roadmap/issues/28

General Questions:

Adria: Census is great - could i get responses shared
- Rufus would say this should be kept to only e.g. tech team or steering group - people may have submitted thinking stuff was confidential ...
Rufus: CKAN extension registry - https://github.com/ckan/ideas-and-roadmap/issues/22
- ckan.org ...
Rufus: CKAN Service provider Directory - https://docs.google.com/a/okfn.org/forms/d/1ljyAam2fYtO2i9JLM5ZDjE8clqidAHMXq91kVglRFBE/edit?usp=drive_web
- Idea: from the http://ckan.org/2014/03/11/improve-how-the-ckan-community-works-your-suggestions-wanted/ survey
Rufus: recent chats with data.gouv.fr - have created ckan-lite in flask, but have committed to coming back. encourage more engagement & invite to tech team.
Nick: Dockerfile
- primary motivation is making installs for end users easier, developer benefits secondary
- adria: against master, use apache / mod_wsgi (consistency for support, docs) - both agreed
- sean: needs docs, same default directory (for consistency) - agreed
- vitor: let's get our tests using docker, separate work for later

--- nigel away, deferred

Nigel: responsive branch
Nigel: Post to ckan-announce about datapusher bug / new package release
Nigel: ckanext-searchhistory

Meeting 2014-05-20

Chair: Adria

Notes: Ian

#1707 - show a resource in any dataset, adria to help fix controller tests
#1652 - nigel to look at
#1724 - to discuss on thursday
#1721 - avoids an extra get request on signup - nigel to review
#1658 - passlib, nick and a number of us to view and comment, ian assigned
#1701 - solr indexing current date on empty fields - joe
#1723 - joe assigned
#1711 - david raznick's opinion of some changes sought, will merge first anyway

Issues (231 open)

no new issues! (applause)

General Questions:

Rufus Pollock: review of draft post about technical team - https://docs.google.com/a/okfn.org/document/d/1ecqTGtX9FQPNgzlFB9my5tqK27xZ7rEC3D-hu-hyqq8/edit
- AGREED: look today, add corrections by 10am tomorrow and then RP to post
Rufus Pollock: CKAN Community Hangout 28th May - http://ckan.org/2014/05/19/ckan-community-hangout-may-2014/
- @Ian: will you be able to make it - yes
ckan-news coming up soon
- Newsletter scratchpad - any thoughts - https://docs.google.com/a/okfn.org/document/d/15giHeBLFWPEwJuDS6mAwwn9y3xw_sscCruZBi0sN0Hk/edit
ckan assoc roles - wip - https://docs.google.com/a/okfn.org/document/d/1vAxwTAVCEW0WMzD2UOOrIGDAKKYCOnQCQzPOYUj_4YI/edit
ckan-discuss migration to google groups
Heads up - http://csvconf.com/
DKAN - relationship with CKAN association (Maybe this does not need to go the Wiki?)
- Not blessed, not part of CKAN association
- Agree with them how we talk about each other
- Would like to see API compatability
- Happy to collaborate on components

-- rest punted until Thursday

Census is great - could i get responses shared
Nigel: responsive branch
Nigel: Post to ckan-announce about datapusher bug / new package release
Nigel: ckanext-searchhistory

Meeting 2014-05-15

Chair: amercader
Notes:

#1711 pr is ready, original intention seems to be that you cannot update packages in organization update. pr fixes this (and the broken test)

Issues (233 open)

General Questions:

dread - reports show&tell - (http://data.gov.uk/data/report) make into extension? Yes!
wardi - context antipatterns - to put into ideas issue and get feedback from kindly, before assigning some CKAN Assoc time to it.
joet - registering users saves username/pass to apache log files.
nigelb - responsive 2.2 (https://github.com/ckan/ckan/tree/responsive-2.2 )

Meeting 2014-05-13

Chair: Nigel

Notes: Adrià

#1711 wardi: package memebership to orgs is defined both in member table and owner_org field, probably to ensure uniqueness. Also group_dict_save does a commit half way which looks really bad (https://github.com/ckan/ckan/blob/master/ckan/lib/dictization/model_save.py#L426) wardi to investigate
#1668 nigel
#1659 needs some tests
#1665 Add datasets to any group regardless of membership. Do we need a config option or users should use custom auth functions (nigelb says that won't be enough

Issues (230 open)

#1715 Assigned to Ross
#1713 Ask user to test on master and see if it's still fails
#1712 Assigned to vitor
#1710 Ask user for a patch
#1709 How do we manage multiple extras in multiple resources? Assigned to adrià
#1708 Ask user for a patch, assigned to joe
#1706 leave as is
#1705 remove /dataset/search endpoint. Ask more details about user extension that might be causing the issue

General Questions:

amercader: https://github.com/ckan/ckan/issues/1714 https://github.com/ckan/ckan/blob/master/ckan/logic/action/get.py#L2053 on CLI commands, session not handled as well as a web response. Try to change commit_and_remove on get_site_user by commit. Joe to look into cli db initialization field
wardi: organization_update packages again - adria says no more special behaviours for group/org_update for users field Investigate if _patch actions can be helpful here

Meeting 2014-05-08

Chair: amercader
Notes: nigelb

Pull Requests (45 open)

#1665: nigel already reviewing.
#1679: new type of action. should probably be in its own file. lets you provide a json patch to update a package. allows us to do atomic updates or updates that don't clobber each other. Ian wants feedback and someone else to take the issue :) json patch is list of operations. there's move, test, etc. So you can test your patch if a certain parameter fails. You can make it fail if it isn't what you wanted it to be. You can update a resource object or add a resource. If you want to update a whole resource you can do that. David asks if we would use revision id, Ian clarifies that is not how it's done. We're using a json patch library. It needs to be wrapped in things. The four lines it is right now is not complete. This is not atomic. If we want it to be better, we can build the patch into package_update. All of the business logic will need to be explicit, like about resources. The complexity will be in package_patch. We will need to consider what happens when someone sends an empty list of extras. We don't want to break anything. package_update should stay as is. It could potentially provide atomic updates to our user. There's more work, like it's own module and validation. Ian will stay assigned. Generally agreed it'll be really cool. The sooner we integrate, the better.
[#1696](https://github.com/ckan/ckan/1696) Groups authorization bug. Nigel to continue working on.
#1251 ongoing
#1697 Ian to look again
#1677 Vitor already reviewing
#1512 Vitor will review. Need to check about localization.
#1688 Adria to look
#1617 assigned already
#1605 assigned already
#1659 need to talk about tests

Issues (221 open)

#1704 Need to take a look at library support. Allowing HTML is scary. Assigned to Nigel.
#1701 If you're building a filter with dates, you'll get a lot of datasets with index date. We could also have 2 fields, one for string. And one for indexed. But the date field in solr will still be a proper date field. Adria already has a patch. We can discuss more.
#1700 Vitor and Nigel to figure out. * ubuntu 14.04 support - to be decided about packages. We don't support ckan 1.8 unless there's a massive security bug.

General Questions:

(amercader) Feedback on CKAN surveys. Add stuff, remove? http://pad.okfn.org/p/ckan-surveys
(ian) functional tests with webtest: We need a way to test controllers. The suggestion is to start using webtest again, because in the scenario we don't care about js. Unless there's opposition, we'll use webtest with BeautifulSoup. Let's write one example with a pull request to discuss next week. Nigel to do this. David Read already has an example: https://github.com/ckan/ckan/blob/master/ckan/new_tests/controllers/test_util.py
(nigel) Template tracebacks. Nigel wrote pull request to catch all exceptions so templates don't blow up. We should do a wrapper or something. Adria thinks helper should catch all expected exceptions. Catch the exception but re-raise it if debug mode is on. Otherwise make sure it sends an email. Ian wants the emails sent out. And about failures that may be related to us catching the exceptions. Agreed that catching all exceptions is a bad thing.
(vitor) Logic about querying models outside of the models themselves: There were few places where we're querying models, like cli.py. Should we refactor that into models themselves. Adria agrees that this is a good idea. If the method from the model returned a query, we could add more filters. The might raise DetachedInstanceError. Vitor will bring up on ckan-dev about a more concrete example.
(ian) vdm removal + sql for clearing old revisions (support from statcan). The options Ian had were clearing all revisions or dumping the packages into a clean database. Re-creating datasets might change UUIDs. David has a script that delete revisions (It's incredibly hard to do). Ian will try to convince new people to work on removing vdm.
- https://github.com/datagovuk/ckanext-dgu/blob/master/ckanext/dgu/bin/wms_revisions.py
Clearing harvest sources (purging all its datasets) https://github.com/ckan/ckanext-harvest/blob/master/ckanext/harvest/logic/action/update.py#L110
(ian) rename new_tests->tests and tests->legacy_tests: +1

Meeting 2014-05-06

Chair: joet
Notes: vitorbaptista

Pull Requests (44 open)

#1665 - take care with how this changes the organization permissions as well (nigelb)
#1679 - everyone agrees that it's a cool feature, but needs more discussion. we will revisit, please add your comments to the PR. (wardi)
#1697 - needs more convincing. vitor will add a good test name that's over the line length limit to prove the point (vitorbaptista)
#1659 - 2-stage dataset create is done, just missing (frontend) tests (vitorbaptista)

Issues (221 open)

General Questions:

nigelb: Do we land UI changes without tests or do we write old tests rather than no tests?
- we wondered what' s the issue with webtest. Nigel suggested doing integration tests with webtest through the controllers, and capybara (or something else) for pages that need javascript.
- Ian would like to unit test controllers. Nigel disagrees, saying that controllers are an integration point, so we shouldn't test them in isolation. Using webtest for controllers is fine. And we can use something for integration tests with javascript later.
- All in all, we felt webtest was good, but we would like to hear seanh/amercader opinions on this. Nigel'll mail ckan-dev talking about it.
vitorbaptista: pull requests with commit messages not following our guidelines
- ask the person sending the PR to read http://docs.ckan.org/en/latest/contributing/commit-messages.html

Meeting 2014-05-01

Chair: amercader
Notes: nigelb

Pull Requests (48 open)

#1692 assigned to vitor
re: clean_action pull requst, it breaks calling dataset_show instead of package_show

Issues (230 open)

#1696 nigel to take a look. reproducable.
#1694 sean will fix.
#1598 If you hit the back button in the third page, the data in the third page is lost. The two state data creation might help. The state gets messed up by the package controller. There's no easy solution. We could use hidden fields without breaking customization.

General Questions:

amercader: Proposal, dev polls. To know more about the ecosystem, help decide roadmap and recruit help
- Deployment: What OS do you use, Source install or package, How do you find the install instructions? Solr/ Postgres same machine, What OS would you like to see supported, Would you be willing to help test new releases on your distro? - generally agreed this is a good idea. amercader will setup a demo by next week.

Meeting 2014-04-29

Chair: wardi
Notes: nigelb