Feature/Docs Request - ability to output to a relative path outside VS solution

.NET APIs and UI code are typically separated into repositories or folders.
Is there a way to configure the file output folder path to accomplish this?
i.e. given these folders Code\MyApiProject (c#) and Code\MyUI (html, typescript etc)
Can I somehow specify an output filter path to be "../../MyUI"?

You can use whatever path you want (relative/absolute) in the save instruction:
{{ config.AddGeneratedFilesToVSProject = false
   capture output
       for class in data.Classes
           class.FullName | String.Append "\r\n"
      end
   end
   Save output "../../MyUI/index.txt"
}}


TOOL: "Metrics" dashboard inside the tool

All tickets related to the "Metrics" Dashboard will go in this epic

Dashboard prototype: https://digital-journeys-dev.apps.silver.devops.gov.bc.ca/insights
Metrics: https://digital-journeys.apps.silver.devops.gov.bc.ca/metrics
Digital Journeys
forms-flow-web

#1212 covers this. dont need this epic


don't default max_seq_length to 128 for executorch models

🐛 Describe the bug
ExecuTorch has a bug right now so we need to default max_seq_length to 128.
Once this has been fixed remove the default here and during export.
https://github.com/pytorch/torchchat/pull/1184
Versions
N/A

what's the bug?


Add Beth Tfiloh (btfiloh.org)

Adding new school (k-12) Beth Tfiloh

@Arkitecht First stage of verification passed, official domain is bethtfiloh.com as far as I verified. This is just an informational note. Pull request is still in the review. I appreciate your patience while waiting for the final decision. Proof of domain ownership: https://www.bethtfiloh.com/calendar/services-calendar

@Arkitecht Thank you for your patience while waiting for a review and processing your request. Pull request merged.


Script redirects to ipv4.google.com

As soon as I activate the script every google page gets redirected from google.com to ipv4.google.com. Clicking on the images tab gives me then the error 404 not found.
https://www.google.com/search?q=github
-->
https://ipv4.google.com/search?q=github
-->
https://ipv4.google.com/search?q=github&newwindow=1&sxsrf=ALeKk01G9DNLg12zJi9H4BrwSp6LAzORHA:1587337951325&source=lnms&tbm=isch&sa=X&ved=2ahUKEwjklejVzvXoAhVLxcQBHUAuAs4Q_AUoAXoECCsQAw&biw=2560&bih=1307

this has been resolved, please update the script and clear all storage from tampermonkey, (make sure advanced settings are enabled to see the storage tab)
another easy way is to just completely remove the script then install it
closing this issue, please reopen if issue persists


[WIP] First round of miving the management of temporary attachments to its own class

It's just kind of masking the complexity, though... well it makes code a bit more easy (maybe).
The idea is similar to what I did in the past with another session variable: a sort of wrapper around $_SESSION['temp_attachments'] with the bonus of moving some methods to the class allowing for some work once spread around to be now in a single place.
Still requires some work. :stuck_out_tongue: (And a lot of documentation blocks lol)
Up for comments!

I'm still taking it all in !

@Spuds while breaking everything I can break, I found this:
https://github.com/elkarte/Elkarte/blob/f3d4ce57ce9d04accaaab8b709da3eaafe510229/sources/subs/Emailpost.subs.php#L883
https://github.com/elkarte/Elkarte/blob/f3d4ce57ce9d04accaaab8b709da3eaafe510229/sources/subs/Emailpost.subs.php#L913
they are just few lines apart, but have a different aspect.
I don't have a lot of knowledge of the PbE stuff, by the look of it and thinking it may be working under kind of CLI/cron, I would tend to think the first seems the correct one (because allowedTo may be fail unless the proper user is set up... that could be an option), but I'm not sure at all... what do you think?

I also feel the first one is the correct syntax for the reasons you stated.   I added the attachment support towards the end of working on PBE and TBH its not been tested a lot nor probably used much in real world forums, but its a goodie for sure.
Since you are working on the attachment code, consider just integrating in the attachment resize code, I feel that should be part of the core these days (given the stupid size of photo images these days)

Spuds wrote on 06/11/2019 22:31:

I also feel the first one is the correct syntax for the reasons you
stated. I added the attachment support towards the end of working on
PBE and TBH its not been tested a lot nor probably used much in real
world forums, but its a goodie for sure.

/me knows the feeling :D

Since you are working on the attachment code, consider just
integrating in the attachment resize code, I feel that should be part
of the core these days (given the stupid size of photo images these days)

Is it that one?
https://github.com/Spuds/Elk_Resize_Attachment_Images

Thats the one ... There is a 1.1 bug for which I posted a potential fix (on the site).  The addon ran when a file was added to the attachment area, and then again when the post was submitted.
That double action seemed to cause a filestat error sometimes ... ensuring it only runs once appears to have solved that.  The fix I posted on the site has it only run during post figuring thats the safest option but of course no longer running on the ulattach action can lead to late failures in the upload which kind of sucks.
The other annoyance is that the addon sets the allowable form size to system max values, otherwise the form would reject the file before we could work on it.  Our attachment form/js only has one size and it really needs 2 ... one for images that we can resize/shrink and one for the rest so if someone tries to upload a big pdf it will be rejected on attach vs on post.

Since I started heavily messing with attachments I started wondering: do we really need a whole new entry for the thumbnails?
Any attachment that has a thumbnail has two entries in the db, one for the attachment and one for the thumbnail.
From what I understand the main advantage of this solution is mostly to have a fast way to calculate the size and number of files in the directory without having to resolve to probing the file system, and it should allow us to store the attachment in a directory and the thumbnail in another (in case for example we are close to the limit and the image fits, while the thumbnail goes above said limit).
Apart from that, it forces a LEFT JOIN of {db_prefix}attachments when we want to show the thumbnail in the page.
So I was thinking it:

drop the "requirement" of having the second entry for thumbnails
move the size to a new column in the attachments table
adapt the queries.

Probably not in this PR, though. :smile:

@Spuds related instead to the image resize: have you ever experimented with client-side resizing?
I was thinking that if we can resize the image client-size, we can avoid changing the server-side logic entirely, so: if you have js enabled it resizes the image client side (saving 1) server load, 2) bandwidth, 3) work for us), if you have js disabled (mostly me alone) it simply refuses the image.
TBH I never tried it, what do you think?

I do remember looking into this using html canvas and its image manipulation functions, but it was several years ago so I'm sure the issues I found are probably no longer relevant.  Its certainly something to revisit to see how its performance and browser support is (especially via smart phones which are the primary suppliers of those large images)

I did some more reading and we will need a library to do this to avoid going backwards in terms of the down sampling quality.    The built in functions in canvas do a rather poor job in terms of the down sampling quality, we need to stay with a Lanczos based filter and a touch of unsharp mask to keep the quality decent.   There are some old browser support issues as well, mainly with allowed canvas size and the ability to create / copy the blobs.  Seems like the Pica library would be a good choice, there are others but what I've found are either massive or use other suspect re-sampling algos.
We may also want to implement the rotation correction code client side (will require a JS exif library), otherwise the displayed icons in the D&D area will be sideways or we simply still correct them server side and leave the interface thumbnail wrong.
I can take a wack at this if wanted, or you can.  Either way while its being investigated we can decouple this PR and the resize stuff so its a step at a time.


Added "TimelineCards" library

Project URL

https://github.com/vladaverin24/TimelineCards
Description

Presenting timelines as cards, single or bundled in scrollable feed!
Why it should be included to awesome-ios (optional)
Checklist

[X] Only one project/change is in this pull request
[X] Addition in chronological order (bottom of category)
[ ] Supports iOS 9 / tvOS 10 or later
[ ] Supports Swift 4 or later
[X] Has a commit from less than 2 years ago
[X] Has a clear README in English

Please use format “Add Project” in the future
Thx


Docker backup

Proposed Changes

Added a script for backing up the PSQL database in the docker container
Added docs to set up the cronjob in README.md
Edited the compose file to mount a local directory to new directory inside the container
Added docs to restore the container's database
Fixed some typos

Associated Issue

https://github.com/ohcnetwork/care/issues/2301
The backup script works perfectly
Mounted a local directory to a new directory(backup) inside the container, so that the user can move the backed up sql file inside this local directory and restore the container's database
The backup.md doc will help the user to restore the container's database

Architecture changes

Added a new doc

Merge Checklist

[ ] Tests added/fixed
[ ] Update docs in /docs
[ ] Linting Complete
[ ] Any other necessary step

Only PR's with test cases included and passing lint and test pipelines will be reviewed
@ohcnetwork/care-backend-maintainers @ohcnetwork/care-backend-admins

Been on this for months now, When i started working all i knew was a bit of shell scripting i learned for a hackathon. i was about to give up then one of the maintainers called me and told me that this will be a great opportunity for me to learn new things and he was right, i learned a damn lot. Thing is i don't get much time for doing this things, but i will be working on this, got a couple of ideas to make the restoration easier. so yeah there will be more pr's :)


Add qgb contract querying functionality to the cli

Ideally, we should be able to use the cli to quickly query current state of the qgb contracts just like we can with state on celestia.

per sync discussion, this issue can be closed just because its very low priority


Switch to Gradle 7.0 causes "unknown property 'runtime'"

When I switch to Gradle 7.0 https://github.com/ytai/ioio/pull/250/files I run into a build error
Current Behavior
I run into
> Could not create task ':HelloIOIOConsole:distJar'.
   > Could not create task of type 'OneJar'.
      > Could not get unknown property 'runtime' for configuration container of type org.gradle.api.internal.artifacts.configurations.DefaultConfigurationContainer.

This is the causing block
plugins {
    id "com.github.onslip.gradle-one-jar" version "1.0.6"
}

task distJar(type: OneJar) {                              <--- This is the error line !
    mainClass = 'ioio.examples.hello_console.HelloIOIOConsole'
}

Steps to Reproduce
https://github.com/ytai/ioio/pull/250/files
Environment
Here you see the error https://github.com/ytai/ioio/pull/250/checks?check_run_id=2340438978

This seems to be the reason https://github.com/gradle/gradle/issues/16823#issuecomment-819276895

@hannesa2  have find a workaround?

@mathieuruellan No

I hit this issue today as well

@mathieuruellan @ShaneF67  I made it work
with this pull request https://github.com/ytai/ioio/pull/250
especially with this commit https://github.com/ytai/ioio/pull/250/commits/08c6dd38a6e4c
It all based on my fork https://github.com/hannesa2/gradle-one-jar


Front End Tests

Stores:

coachStore
projectStore
skillStore

Components:

x

#214

Current status:

Currently trying to mock axios so we can intercept the API calls and replace it with test data.

Codecov Report

Merging #305 (3d9a7da) into main (e8c6440) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #305   +/-   ##
=======================================
  Coverage   95.36%   95.36%
=======================================
  Files          12       12
  Lines        1015     1015
=======================================
  Hits          968      968
  Misses         47       47

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more


Youtube-dl won't download a video from a specific URL on youtube

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like that [x])
Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.04.11. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2017.04.11

Before submitting an issue make sure you have:

[x] At least skimmed through README and most notably FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add -v flag to your command line you run youtube-dl with, copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
$ youtube-dl -v <your command line>
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'http://www.youtube.com/watch?v=BaW_jenozKcj']
[debug] Encodings: locale cp1251, fs mbcs, out cp866, pref cp1251
[debug] youtube-dl version 2017.04.11
[debug] Python version 2.7.11 - Windows-2003Server-5.2.3790-SP2
[debug] exe versions: ffmpeg N-75573-g1d0487f, ffprobe N-75573-g1d0487f, rtmpdump 2.4
[debug] Proxy map: {}
...
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Single video: https://www.youtube.com/watch?v=BaW_jenozKc
Single video: https://youtu.be/BaW_jenozKc
Playlist: https://www.youtube.com/playlist?list=PL4lCao7KL_QFVb7Iudeipvc2BCavECqzc

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.

Description of your issue, suggested solution and other information
Explanation of your issue in arbitrary form goes here. Please make sure the description is worded well enough to be understood. Provide as much context and examples as possible.
If work on your issue requires account credentials please provide them or explain how one can obtain them.
Hey, I have been trying to download the audio from https://www.youtube.com/watch?v=vISSxIDytI0 and it wasn't working, so I tried to download the video and the audio and it still didn't work. I would suggest a way to fix it but I'm not really sure of a way you could. It works when i download the audio from other videos on youtube (i downloaded audio from https://www.youtube.com/watch?v=v1B80DsHwc8 just moments before) Here is the command and output:
[youtube] vISSxIDytI0: Downloading webpage
[youtube] vISSxIDytI0: Downloading video info webpage
[youtube] vISSxIDytI0: Extracting video information
[youtube] vISSxIDytI0: Downloading js player en_US-vflaxXRn1
ERROR: Signature extraction failed: Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/youtube.py", line 905, in _decrypt_signature
    video_id, player_url, s
  File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/youtube.py", line 819, in _extract_signature_function
    errnote='Download of %s failed' % player_url)
  File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 468, in _download_webpage
    res = self._download_webpage_handle(url_or_request, video_id, note, errnote, fatal, encoding=encoding)
  File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 375, in _download_webpage_handle
    urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal)
  File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 355, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/lib/python2.7/dist-packages/youtube_dl/YoutubeDL.py", line 1905, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python2.7/urllib2.py", line 421, in open
    protocol = req.get_type()
  File "/usr/lib/python2.7/urllib2.py", line 283, in get_type
    raise ValueError, "unknown url type: %s" % self.__original
ValueError: unknown url type: /yts/jsbin/player-en_US-vflaxXRn1/base.js
 (caused by ValueError(u'unknown url type: /yts/jsbin/player-en_US-vflaxXRn1/base.js',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.```

You are using an outdated version of youtube-dl. Read this FAQ entry if you have troubles updating.

@dstftw I was pretty sure I updated, but it turns out I forgot to add the PPA when I installed it, it's updating now and hopefully when it's updated it will work, thanks :)

Something else that also helps for Windows users: if you get Access denied upon updating it, go to the directory you have it installed in, and replace youtube-dl.exe with youtube-dl.exe.new. Something is preventing the new file from being copied to the old one.


Add support for Elasticsearch 7.x and 8.x indexing

Hi, thanks for this cool project. I have added support for indexing pages in ES 7 & 8. I did not update the ACHE frontend search functionality, which likely also needs changes for full compatibility. But I think people will already enjoy the indexing part, since the newer ES versions >= 7.8.0 also come with docker images supporting linux/arm64/v8 OS/architecture (crucial for M1 Macbook users).
I have tested indexing with Elasticsearch version 7.17.0 and 8.2.2.
I used the following docker-compose.yml. Note that the xpack.security config values are important for local development without any security.
version: '2'
services:
  ache:
    image: vidanyu/ache
    command: startCrawl -c /config/ -s /config/docker.seeds -o /data -e crawl-data
    ports:
    - "8080:8080"
    volumes:
    - ./data-ache/:/data
    - ./:/config
    links:
    - elasticsearch
  elasticsearch:
    image: docker.elastic.co/elasticsearch/elasticsearch:8.2.2
    environment:
      - discovery.type=single-node
      - cluster.name=docker-cluster
      - bootstrap.memory_lock=true
      - xpack.security.enabled=false
      - xpack.security.transport.ssl.enabled=false
      - xpack.security.http.ssl.enabled=false
    ulimits:
      memlock:
        soft: -1
        hard: -1
    volumes:
      - ./data-es/:/usr/share/elasticsearch/data # elasticsearch data will be stored at ./data-es/
    ports:
      - "9200:9200"

Until this pull request is accepted you may need to build your own image based on my changes and reference it in the docker-compose.yml instead of vidanyu/ache.
I am open for changes, but currently am not planning on doing the frontend part as well.
Cheers

Thanks for the contribution. Can you please rebase on the master branch and squash the commits? For some reason, GitHub is not showing the diff correctly.

Just noticed this is due to commit c97fde2 which changes the line separators. Do you happen to know what were the line separators before and after the commit?

Just noticed this is due to commit c97fde2 which changes the line separators. Do you happen to know what were the line separators before and after the commit?

Before the commit they were CRLF and after it LF. I changed it, since most of the other code I looked at is formatted with LF (Unix and macOS) and my IDE showed a warning.

No need for change. GitHub can squash all commits during the merge. Thanks for the PR!


Draft: Keep track of source of config values

Description
Per title.
How was this PR tested?
Pending

Superseded by #2212, closing.


kube?

I saw you recently starred kube. I would love to hear your thought...

Saw it on KN, thought it looked interesting!

https://github.com/uptownhr/kube

Maybe we could discuss in that repo?  It seems that kube is really new, so I planned on giving it a whirl sometime soon to see how it could help users out.

would love that. feel free to start a thread there.  what is kn btw?
On Sat, Jun 11, 2016, 9:07 PM Eric Clemmons<EMAIL_ADDRESS>wrote:

Saw it on KN, thought it looked interesting!
https://github.com/uptownhr/kube
Maybe we could discuss in that repo? It seems that kube is really new, so
I planned on giving it a whirl sometime soon to see how it could help users
out.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/ericclemmons/webpack-hot-server-example/issues/5#issuecomment-225409018,
or mute the thread
https://github.com/notifications/unsubscribe/AA-Utu5VbVXAGPfOOiRlhF-jOwj2h7Tqks5qK4YegaJpZM4IzrX6
.

Haha, sorry, HN!  (HackerNews)
I'll open up an issue on kube when I get to try it out this week.  See you there!


[Fix #9205] Update Naming/MemoizedInstanceVariableName to handle dynamically defined methods

Naming/MemoizedInstanceVariableName was previously not aware of dynamically defined methods, and when defined inside another method (such as a module's inherited callback), it used the wrong value as the method name.
Fix to be able to find define_method and define_singleton_method and use that as the node to check against, so that the recommended ivar name is correct.
Fixes #9205.

Before submitting the PR make sure the following are checked:

[x] The PR relates to only one subject with a clear title and description in grammatically correct, complete sentences.
[x] Wrote good commit messages.
[x] Commit message starts with [Fix #issue-number] (if the related issue exists).
[x] Feature branch is up-to-date with master (if not - rebase it).
[x] Squashed related commits together.
[x] Added tests.
[x] Ran bundle exec rake default. It executes all tests and runs RuboCop on its own code.
[x] Added an entry (file) to the changelog folder named {change_type}_{change_description}.md if the new code introduces user-observable changes. See changelog entry format for details.

Great changes, just make sure to also reflect them in the cop's examples.

@bbatsov updated the docs

Nice! Thank you!


Ability to provide SessionFilter globally

Hi,
We are making use of the SessionFilter feature in our tests. However, we would like the ability to apply this filter globally rather that having to apply it to each and every test. Is this possible?

Yes, use a global request specification to which you supply the session filter. Something like:
RestAssured.requestSpecification = new RequestSpecBuilder().addFilter(new SessionFilter(..)).build();

Also I would prefer if you would please use the mailing list when asking questions in the future :)

Thanks Johan, and apologies for raising an issue. I'll use the mailing list
in the future.
Kind regards,
Jonathan Stearnes
On 31 August 2017 at 08:19, Johan Haleby<EMAIL_ADDRESS>wrote:

Closed #898 https://github.com/rest-assured/rest-assured/issues/898.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/rest-assured/rest-assured/issues/898#event-1228983333,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABkJAWJ7mRVVEf9UNqiLjaIEnLUIOhUTks5sdl5ngaJpZM4PH-7t
.


Please update your repo to match what's present in our master branch currently.


Can I use tokens in skip function?

Hi there,
For example, I want to log any request-response with response-time longer than 100 ms.
I know I can define a custom skip function,
but since response-time is already defined as a token, can I use it in skip function?

app.use(morgan('combined', {
  skip: (req, res) => Number(morgan['response-time'](req, res)) <= 100
}))


Comparison to other prefix matching

My question is just about the core algorithm. There is a special case I could not see the algorithm solving. Say there is a Query String foob and I want to match it against the following list of known strings:
0 foobar
1 offer
2 bars
3 rams
4 arms
5 fooz

Notice that by the time I get through to foobar (being the longest), there are no unique characters left to fill the UniqueChars table, which I think would be like:
0  1  2  3  4  5
   o  b  r  a  f

What goes in the 0th index/slot?
If we fill it with Null/empty my understanding is that the subsequent masks will never be populated correctly  to find foobar,  right? What am I missing?
Best
Sid

In that example, where foob is your query string... it doesn't actually "prefix match" any of the items in that table.  The query string needs to be longer than or equal to one of the strings in the able in order to be considered a prefix match.
For what it's worth, the unique chars and unique index for that particular string table combo is as follows:
b - 0
r - 0
a - 0
f - 0
o - 0
o - 1
So there's no conflict from the perspective of unique chars etc.  (If your query string was, say, "foobar123456", it would end up matching the first slot.)


Interest in MATLAB wrapper?

I am currently working on a simplistic MATLAB wrapper of GLVis. Originally, I intended to create a repo for it on my account. However, if this organization is interested in it, I could create the repository inside the GLVis organization.

Hi @CsatiZoltan,
Yes that will certainly be of interest.
One option is that you start the development in your account and then transfer the ownership of the repository to the GLVis organization. This is what we did with https://github.com/mfem/PyMFEM.
Another option is to create the repository directly inside the GLVis organization.
I'm OK with both options :).
Cheers,
Tzanio

I start it with my account and when it's mature, I will reopen this issue to discuss if you want it or not to be transferred.


Add owl-shop

https://github.com/cloudhut/owl-shop
https://github.com/timeplus-io/proton/blob/develop/examples/ecommerce/docker-compose.yml

closed, duplicate of #768


RuntimeError: Cannot prepare multiple statements at once

Can not IMPORT DATABASE from prev EXPORT DATABASE (export ok)
EXPORT DATABASE file:
--- target_directory
------ load.sql, people.csv, schema.sql
My code:
`import duckdb
conn = duckdb.connect()
cursor = duckdb.connect(database=':memory:', read_only=False).cursor()
print(cursor.execute("CREATE TABLE people(id INTEGER, name VARCHAR);").fetchall())
print(cursor.execute("INSERT INTO people VALUES (1, 'Mark'), (2, 'Hannes');").fetchall())
print(cursor.execute('SHOW TABLES').fetchall())
print(cursor.execute("SELECT * FROM read_csv_auto('mysql-server.csv');").fetchall())
print(cursor.execute("EXPORT DATABASE 'target_directory'").fetchall())
print(cursor.execute("IMPORT DATABASE 'target_directory'").fetchall())
conn.close()`
run output:
Traceback (most recent call last):   File "duckdb-python.py", line 41, in <module>     print(cursor.execute("IMPORT DATABASE 'target_directory'").fetchall()) RuntimeError: Cannot prepare multiple statements at once!
When I only connect and import , It is also error ,  the same error, any advice ?
I just want EXPORT data in one program, and IMPORT in same or another program...

Thanks for the report! This seems to be an error with the Python client not being able to handle multiple statements in the same call to execute. I will have a look at fixing it. For now, as a work-around, you can load the schema.sql and load.sql files yourself from the database directory, e.g.:
import duckdb
import os
# export database
con = duckdb.connect(":memory:")
con.execute("CREATE TABLE integers(i INTEGER)");
con.execute("CREATE TABLE integers2(j INTEGER)");
con.execute("EXPORT DATABASE 'target_dir'")

def execute_multiple_statements(con, fname):
    with open(fname, 'r') as f:
        statements = f.read()
    for statement in statements.split(';'):
        if len(statement.strip()) == 0:
            continue
        con.execute(statement)

# reload
con = duckdb.connect(":memory:")
execute_multiple_statements(con, os.path.join('target_dir', 'schema.sql'))
execute_multiple_statements(con, os.path.join('target_dir', 'load.sql'))

This should be fixed in the master now, can you install the latest master with pip3 install duckdb --pre and check if that fixes the issue for you?

Thanks , sorry, I use python 2.7 building from python source tar.gz ...

You can find the latest python source here: https://github.com/cwida/duckdb/releases/download/master-builds/duckdb_python_src.tar.gz

Thanks all, now work well...


fix license script

Issue #, if available:
after #912 python tests failure
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@shohamazon have you ran this locally through the CI, to verify it fixes everything?

@shohamazon have you ran this locally through the CI, to verify it fixes everything?

yes,
black ../utils/get_licenses_from_ort.py
  All done! ✨ 🍰 ✨
  1 file left unchanged.
mypy ../utils/get_licenses_from_ort.py
  Success: no issues found in 1 source file


[SPARK-34360][SQL] Support truncation of v2 tables

What changes were proposed in this pull request?

Add new interface TruncatableTable which represents tables that allow atomic truncation.
Implement new method in InMemoryTable and in InMemoryPartitionTable.

Why are the changes needed?
To support TRUNCATE TABLE for v2 tables.
Does this PR introduce any user-facing change?
Should not.
How was this patch tested?
Added new tests to TableCatalogSuite that check truncation of non-partitioned and partitioned tables:
$ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *TableCatalogSuite"

Test build #134876 has started for PR 31475 at commit b77a210.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39464/

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39464/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39464/

Test build #134876 has finished for PR 31475 at commit b77a210.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

@cloud-fan @HyukjinKwon Could you review this, please.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134876/

@cloud-fan @HyukjinKwon Any objections to this PR?

LGTM, also cc @rdblue @imback82 @dongjoon-hyun

@MaxGekk, why is this necessary instead of deleting from the table or overwriting everything with no new records? I don't see a good reason to do this, especially at the catalog level instead of the table level. Introducing new ways to do something that is already possible over-complicates the API and is a step in the wrong direction.
Please consider this a -1 until we come to consensus -- I may support it in the end, but I don't want anyone choosing to commit despite disagreement in the mean time.

... why is this necessary instead of deleting from the table or overwriting everything with no new records?

By emulating table truncation via the insertion of no rows, you require atomic operations: delete + insert but a concrete implementation might not support this though it can atomically truncate a table.
You close the room for truncation specific optimizations. If a catalog implementation would know in advance that we want to truncate the entire table instead of deleting all rows, it could do that in a more optimal way. Let's say some file based implementation could move the table folder to a trash folder using one atomic syscall.
From security or permissions controls point of view, we could distinguish insert with overwrite (or delete) from truncation. I could imagine a case when some roles/users can have only truncation permissions but not insert or delete permissions.
Also it is possible that truncation op is just a record at catalog level log but inserts/deletes are records at table level logs. So, we cannot smoothly sit on such implementation if we emulate table truncation via inserts/deletes.

In general, I do believe we should not hide our intention from catalog implementations - truncation should be explicit. Table catalog implementation should decide how to implement in a more optimal way. So, if they can emulate truncation via overwriting with no rows, ok, this is up to them.

@MaxGekk, can you share the use case that you have for this? You mentioned truncation-specific optimizations. I think working with concrete use cases is usually a good idea. If these are theoretical only -- like a user that can drop all data but not a subset -- then we should put this off. If there's a specific case, then let's discuss it.
I agree that there may be good reason to pass that the engine's intent was to truncate. That's why we have SupportsTruncate for the write builder. And I agree with you that we don't necessarily need to use an atomic operation that could truncate and add data at the same time. Your point about not having insert permissions is a good one to justify not using SupportsTruncate, although the case of a user that can drop all data but not subsets doesn't sound real. The point about truncation possibly being a metadata operation is why we added SupportsDelete at the table level.
Those points may indicate that an interface to truncate a table as a stand-alone operation is valid, although I still think that it is a bad idea to add more interfaces to v2 without a reasonable expectation that they will actually be used.
Another problem here is that this is operation is proposed at the catalog level, which does not fit with how v2 works. I think that the reason for this is emulating what the Hive does, but that's not usually a good choice.
In v2, catalogs load tables and tables are modified. That's why SupportsDelete extends Table and not TableCatalog. This keeps concerns separate, so we have a way to handle tables that don't exist and a separate way to handle tables that don't support a certain operation. Mixing those two together at the catalog level over-complicates the API, requiring a source to throw one exception if the table doesn't exist and another if it doesn't support truncation. (We also went through this discussion with the recently added interfaces to add/drop partitions.)
Assuming that it is worth adding this interface, I would expect it to be a mix-in for Table. And like SupportsOverwrite that implements SupportsTruncate, I think this should also update SupportsDelete so that tables don't need to implement both interfaces.

... can you share the use case that you have for this?

@rdblue For instance, v2 table catalog for JDBC:

I assume if a table supports the SupportsTruncate interface, it must support atomic remove of all data and write any set of rows (empty and non-empty).
Support of atomic SupportsTruncate is not so easy in the case of JDBC. For example, we still don't support it in JDBC v2 Table Catalog, see SPARK-32595.
DBMS usually provides special command for table truncation (see DB2, Oracle, PostgreSQL, Hive). So, we could map the new method truncateTable to a DBMS command.

@MaxGekk, thanks. Then let's work on updating this to fit more cleanly with the design of v2 catalogs and tables. This should be a Table interface, not an extension to TableCatalog.

Test build #135081 has started for PR 31475 at commit 141919c.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39663/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39663/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39663/

Test build #135081 has finished for PR 31475 at commit 141919c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135081/

I like the idea to allow the catalog implementations to distinguish between TRUNCATE TABLE t and INSERT OVERWRITE t SELECT * FROM empty_table. It seems fine to move the API to the table side. But the name conflict is a bit annoying.
One idea is to keep the name SupportsTruncate, and put it in org.apache.spark.sql.connector.catalog, which is the same package of SupportsDelete. Then there is no conflict.

Test build #135098 has started for PR 31475 at commit 2741a40.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39680/

Test build #135098 has finished for PR 31475 at commit 2741a40.

This patch fails SparkR unit tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135098/

Test build #135103 has started for PR 31475 at commit bcc01e1.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39685/

Test build #135103 has finished for PR 31475 at commit bcc01e1.

This patch passes all tests.
This patch does not merge cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135103/

Test build #135112 has started for PR 31475 at commit 5af950a.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39694/

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39694/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39694/

Test build #135112 has finished for PR 31475 at commit 5af950a.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135112/

Looks good now. Thanks for fixing this, @MaxGekk!

Test build #135121 has started for PR 31475 at commit d1e5a18.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39702/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39702/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39702/

Test build #135121 has finished for PR 31475 at commit d1e5a18.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135121/

Test build #135225 has started for PR 31475 at commit b758060.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39807/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39807/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39807/

Test build #135225 has finished for PR 31475 at commit b758060.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135225/

Merged to master.


Bump analyzer, image-redactor dependencies

Change Description
Describe your changes
Issue reference
This PR fixes issue #XX
Checklist

[ ] I have reviewed the contribution guidelines
[ ] I have signed the CLA (if required)
[ ] My code includes unit tests
[ ] All unit tests and lint checks pass locally
[ ] My PR contains documentation updates / additions if required

/azp run

/azp run


Alot of Errors - Ubuntu 16 - Help wanted-

After it reads that ZcashD is running.
[2018-03-30 18:25:33.0125] [W] [zec1] [Pool] Unable to load pool stats Npgsql.PostgresException (0x80004005): 42P01: relation "poolstats" does not exist
   at Npgsql.NpgsqlConnector.<DoReadMessage>d__157.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()
   at Npgsql.NpgsqlConnector.<ReadMessage>d__156.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at Npgsql.NpgsqlConnector.<ReadMessage>d__156.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()
   at Npgsql.NpgsqlConnector.<ReadExpecting>d__163`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()
   at Npgsql.NpgsqlDataReader.<NextResult>d__32.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Npgsql.NpgsqlDataReader.NextResult()
   at Npgsql.NpgsqlCommand.<Execute>d__71.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()
   at Npgsql.NpgsqlCommand.<ExecuteDbDataReader>d__92.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()
   at Npgsql.NpgsqlCommand.ExecuteDbDataReader(CommandBehavior behavior)
   at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
   at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior) in C:\projects\dapper\Dapper\SqlMapper.cs:line 1053
   at Dapper.SqlMapper.QueryRowImpl[T](IDbConnection cnn, Row row, CommandDefinition& command, Type effectiveType) in C:\projects\dapper\Dapper\SqlMapper.cs:line 1179
   at Dapper.SqlMapper.QuerySingleOrDefault[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType) in C:\projects\dapper\Dapper\SqlMapper.cs:line 803
   at MiningCore.Persistence.Postgres.Repositories.StatsRepository.GetLastPoolStats(IDbConnection con, String poolId) in /home/ultrapool/miningcore/src/MiningCore/Persistence/Postgres/Repositories/StatsRepository.cs:line 86
   at MiningCore.Extensions.ConnectionFactoryExtensions.Run[T](IConnectionFactory factory, Func`2 action) in /home/ultrapool/miningcore/src/MiningCore/Extensions/ConnectionFactoryExtensions.cs:line 51
   at MiningCore.Mining.PoolBase.LoadStats() in /home/ultrapool/miningcore/src/MiningCore/Mining/PoolBase.cs:line 229    at Npgsql.NpgsqlConnector.<DoReadMessage>d__157.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()
   at Npgsql.NpgsqlConnector.<ReadMessage>d__156.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at Npgsql.NpgsqlConnector.<ReadMessage>d__156.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()
   at Npgsql.NpgsqlConnector.<ReadExpecting>d__163`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()
   at Npgsql.NpgsqlDataReader.<NextResult>d__32.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Npgsql.NpgsqlDataReader.NextResult()
   at Npgsql.NpgsqlCommand.<Execute>d__71.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()
   at Npgsql.NpgsqlCommand.<ExecuteDbDataReader>d__92.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()
   at Npgsql.NpgsqlCommand.ExecuteDbDataReader(CommandBehavior behavior)
   at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
   at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior) in C:\projects\dapper\Dapper\SqlMapper.cs:line 1053
   at Dapper.SqlMapper.QueryRowImpl[T](IDbConnection cnn, Row row, CommandDefinition& command, Type effectiveType) in C:\projects\dapper\Dapper\SqlMapper.cs:line 1179
   at Dapper.SqlMapper.QuerySingleOrDefault[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType) in C:\projects\dapper\Dapper\SqlMapper.cs:line 803
   at MiningCore.Persistence.Postgres.Repositories.StatsRepository.GetLastPoolStats(IDbConnection con, String poolId) in /home/ultrapool/miningcore/src/MiningCore/Persistence/Postgres/Repositories/StatsRepository.cs:line 86
   at MiningCore.Extensions.ConnectionFactoryExtensions.Run[T](IConnectionFactory factory, Func`2 action) in /home/ultrapool/miningcore/src/MiningCore/Extensions/ConnectionFactoryExtensions.cs:line 51
   at MiningCore.Mining.PoolBase.LoadStats() in /home/ultrapool/miningcore/src/MiningCore/Mining/PoolBase.cs:line 229

Before the errors above
[2018-03-30 18:25:30.6445] [I] [zec1] [Bitcoin Job Manager] All daemons synched with blockchain [2018-03-30 18:25:31.0582] [W] [StatsRecorder] Retry 1 due to Npgsql: PostgresException (42P01: relation "shares" does not exist) [2018-03-30 18:25:31.1338] [W] [StatsRecorder] Retry 2 due to Npgsql: PostgresException (42P01: relation "shares" does not exist) [2018-03-30 18:25:31.1372] [W] [StatsRecorder] Retry 3 due to Npgsql: PostgresException (42P01: relation "shares" does not exist) [2018-03-30 18:25:31.1408] [W] [StatsRecorder] Retry 4 due to Npgsql: PostgresException (42P01: relation "shares" does not exist) [2018-03-30 18:25:31.1408] [E] [StatsRecorder] Npgsql.PostgresException (0x80004005): 42P01: relation "shares" does not exist    at Npgsql.NpgsqlConnector.<DoReadMessage>d__157.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()    at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)    at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()
at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()    at Npgsql.NpgsqlConnector.<ReadMessage>d__156.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()    at Npgsql.NpgsqlConnector.<ReadMessage>d__156.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()    at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)    at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()
at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()    at Npgsql.NpgsqlConnector.<ReadExpecting>d__1631.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()    at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()
at Npgsql.NpgsqlDataReader.d__32.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Npgsql.NpgsqlDataReader.NextResult()
at Npgsql.NpgsqlCommand.d__71.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()    at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()
at Npgsql.NpgsqlCommand.d__92.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()    at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()
at Npgsql.NpgsqlCommand.ExecuteDbDataReader(CommandBehavior behavior)
at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior) in C:\projects\dapper\Dapper\SqlMapper.cs:line 1053
at Dapper.SqlMapper.d__1361.MoveNext() in C:\projects\dapper\Dapper\SqlMapper.cs:line 1081    at System.Collections.Generic.List1.AddEnumerable(IEnumerable1 enumerable)    at System.Linq.Enumerable.ToList[TSource](IEnumerable1 source)
at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable1 commandTimeout, Nullable1 commandType) in C:\projects\dapper\Dapper\SqlMapper.cs:line 723
at MiningCore.Persistence.Postgres.Repositories.ShareRepository.GetHashAccumulationBetweenCreated(IDbConnection con, String poolId, DateTime start, DateTime end) in /home/ultrapool/miningcore/src/MiningCore/Persistence/Postgres/Repositories/ShareRepository.cs:line 157
at MiningCore.Extensions.ConnectionFactoryExtensions.Run[T](IConnectionFactory factory, Func2 action) in /home/ultrapool/miningcore/src/MiningCore/Extensions/ConnectionFactoryExtensions.cs:line 51    at Polly.Policy.<>c__DisplayClass119_01.b__0(Context ctx, CancellationToken ct)
at Polly.Policy.<>c__DisplayClass129_01.<ExecuteInternal>b__0(Context ctx, CancellationToken ct)    at Polly.RetrySyntax.<>c__DisplayClass5_1.<Retry>b__1(Context ctx, CancellationToken ct)    at Polly.Retry.RetryEngine.Implementation[TResult](Func3 action, Context context, CancellationToken cancellationToken, IEnumerable1 shouldRetryExceptionPredicates, IEnumerable1 shouldRetryResultPredicates, Func1 policyStateFactory)    at Polly.RetrySyntax.<>c__DisplayClass5_0.<Retry>b__0(Action2 action, Context context, CancellationToken cancellationToken)
at Polly.Policy.ExecuteInternal[TResult](Func3 action, Context context, CancellationToken cancellationToken)    at Polly.Policy.Execute[TResult](Func3 action, Context context, CancellationToken cancellationToken)
at Polly.Policy.Execute[TResult](Func1 action)    at MiningCore.Mining.StatsRecorder.UpdatePoolHashrates()    at MiningCore.Mining.StatsRecorder.<Start>b__19_1() in /home/ultrapool/miningcore/src/MiningCore/Mining/StatsRecorder.cs:line 92 Npgsql.PostgresException (0x80004005): 42P01: relation "shares" does not exist    at Npgsql.NpgsqlConnector.<DoReadMessage>d__157.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()    at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)    at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()
at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()    at Npgsql.NpgsqlConnector.<ReadMessage>d__156.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()    at Npgsql.NpgsqlConnector.<ReadMessage>d__156.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()    at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)    at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()
at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()    at Npgsql.NpgsqlConnector.<ReadExpecting>d__1631.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()    at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()
at Npgsql.NpgsqlDataReader.d__32.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Npgsql.NpgsqlDataReader.NextResult()
at Npgsql.NpgsqlCommand.d__71.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()    at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()
at Npgsql.NpgsqlCommand.d__92.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()    at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()
at Npgsql.NpgsqlCommand.ExecuteDbDataReader(CommandBehavior behavior)
at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior) in C:\projects\dapper\Dapper\SqlMapper.cs:line 1053
at Dapper.SqlMapper.d__1361.MoveNext() in C:\projects\dapper\Dapper\SqlMapper.cs:line 1081    at System.Collections.Generic.List1.AddEnumerable(IEnumerable1 enumerable)    at System.Linq.Enumerable.ToList[TSource](IEnumerable1 source)
at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable1 commandTimeout, Nullable1 commandType) in C:\projects\dapper\Dapper\SqlMapper.cs:line 723
at MiningCore.Persistence.Postgres.Repositories.ShareRepository.GetHashAccumulationBetweenCreated(IDbConnection con, String poolId, DateTime start, DateTime end) in /home/ultrapool/miningcore/src/MiningCore/Persistence/Postgres/Repositories/ShareRepository.cs:line 157
at MiningCore.Extensions.ConnectionFactoryExtensions.Run[T](IConnectionFactory factory, Func2 action) in /home/ultrapool/miningcore/src/MiningCore/Extensions/ConnectionFactoryExtensions.cs:line 51    at Polly.Policy.<>c__DisplayClass119_01.b__0(Context ctx, CancellationToken ct)
at Polly.Policy.<>c__DisplayClass129_01.<ExecuteInternal>b__0(Context ctx, CancellationToken ct)    at Polly.RetrySyntax.<>c__DisplayClass5_1.<Retry>b__1(Context ctx, CancellationToken ct)    at Polly.Retry.RetryEngine.Implementation[TResult](Func3 action, Context context, CancellationToken cancellationToken, IEnumerable1 shouldRetryExceptionPredicates, IEnumerable1 shouldRetryResultPredicates, Func1 policyStateFactory)    at Polly.RetrySyntax.<>c__DisplayClass5_0.<Retry>b__0(Action2 action, Context context, CancellationToken cancellationToken)
at Polly.Policy.ExecuteInternal[TResult](Func3 action, Context context, CancellationToken cancellationToken)    at Polly.Policy.Execute[TResult](Func3 action, Context context, CancellationToken cancellationToken)
at Polly.Policy.Execute[TResult](Func1 action)    at MiningCore.Mining.StatsRecorder.UpdatePoolHashrates()    at MiningCore.Mining.StatsRecorder.<Start>b__19_1() in /home/ultrapool/miningcore/src/MiningCore/Mining/StatsRecorder.cs:line 92    at Npgsql.NpgsqlConnector.<DoReadMessage>d__157.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()    at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)    at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()
at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()    at Npgsql.NpgsqlConnector.<ReadMessage>d__156.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()    at Npgsql.NpgsqlConnector.<ReadMessage>d__156.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()    at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)    at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()
at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()    at Npgsql.NpgsqlConnector.<ReadExpecting>d__1631.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()    at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()
at Npgsql.NpgsqlDataReader.d__32.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Npgsql.NpgsqlDataReader.NextResult()
at Npgsql.NpgsqlCommand.d__71.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()    at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()
at Npgsql.NpgsqlCommand.d__92.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.TaskAwaiter1.GetResult()    at System.Runtime.CompilerServices.ValueTaskAwaiter1.GetResult()
at Npgsql.NpgsqlCommand.ExecuteDbDataReader(CommandBehavior behavior)
at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior) in C:\projects\dapper\Dapper\SqlMapper.cs:line 1053
at Dapper.SqlMapper.d__1361.MoveNext() in C:\projects\dapper\Dapper\SqlMapper.cs:line 1081    at System.Collections.Generic.List1.AddEnumerable(IEnumerable1 enumerable)    at System.Linq.Enumerable.ToList[TSource](IEnumerable1 source)
at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable1 commandTimeout, Nullable1 commandType) in C:\projects\dapper\Dapper\SqlMapper.cs:line 723
at MiningCore.Persistence.Postgres.Repositories.ShareRepository.GetHashAccumulationBetweenCreated(IDbConnection con, String poolId, DateTime start, DateTime end) in /home/ultrapool/miningcore/src/MiningCore/Persistence/Postgres/Repositories/ShareRepository.cs:line 157
at MiningCore.Extensions.ConnectionFactoryExtensions.Run[T](IConnectionFactory factory, Func2 action) in /home/ultrapool/miningcore/src/MiningCore/Extensions/ConnectionFactoryExtensions.cs:line 51    at Polly.Policy.<>c__DisplayClass119_01.b__0(Context ctx, CancellationToken ct)
at Polly.Policy.<>c__DisplayClass129_01.<ExecuteInternal>b__0(Context ctx, CancellationToken ct)    at Polly.RetrySyntax.<>c__DisplayClass5_1.<Retry>b__1(Context ctx, CancellationToken ct)    at Polly.Retry.RetryEngine.Implementation[TResult](Func3 action, Context context, CancellationToken cancellationToken, IEnumerable1 shouldRetryExceptionPredicates, IEnumerable1 shouldRetryResultPredicates, Func1 policyStateFactory)    at Polly.RetrySyntax.<>c__DisplayClass5_0.<Retry>b__0(Action2 action, Context context, CancellationToken cancellationToken)
at Polly.Policy.ExecuteInternal[TResult](Func3 action, Context context, CancellationToken cancellationToken)    at Polly.Policy.Execute[TResult](Func3 action, Context context, CancellationToken cancellationToken)
at Polly.Policy.Execute[TResult](Func1 action)    at MiningCore.Mining.StatsRecorder.UpdatePoolHashrates()    at MiningCore.Mining.StatsRecorder.<Start>b__19_1() in /home/ultrapool/miningcore/src/MiningCore/Mining/StatsRecorder.cs:line 92 [2018-03-30 18:25:32.0541] [I] [zec1] [Bitcoin Job Manager] Online [2018-03-30 18:25:32.9386] [I] [zec1] [Bitcoin Job Manager] Detected new block 297594 via RPC polling [2018-03-30 18:25:32.9441] [I] [zec1] [Pool] Broadcasting job

Did you follow the Database setup process?
PostgreSQL Database setup
Create the database:
createuser miningcore
createdb miningcore
psql (enter the password for postgressql)

alter user miningcore with encrypted password 'some-secure-password';
grant all privileges on database miningcore to miningcore;

Import the database schema:
wget https://raw.githubusercontent.com/coinfoundry/miningcore/master/src/MiningCore/Persistence/Postgres/Scripts/createdb.sql
psql -d miningcore -U miningcore -f createdb.sql

@RepoBike Please make sure you imported the database schema. By the look at the log, Miningcore cannot find the tables.

Postsql is working and connect. But the steps shown to make miningcore user is incorrect or something BC it does not allow to make miningcore user. I am able to make databases.
createuser miningcore psql: FATAL:  Peer authentication failed for user "miningcore"
Even trying to make in the PostgreSQL term it does not do anything.

alter user miningcore with encrypted password 'some-secure-password'; grant all privileges on database miningcore to miningcore;
Doesn't do anything

@calvintam236 - Can miningcore talk to MySQL on a different host?

@RepoBike please attach the postgres log on the console. I believe the command on README is outdated.
It is not compatible with MySQL.

Yes seems that most of it is outdated
https://gist.github.com/alistairewj/8aaea0261fe4015333ddf8bed5fe91f8
Link for the updated way to make users and superusers in PostgreSQL.
Made miningcore a supersuer the database is there. Still the same errors.
In one of the errors is trying to read/write in a folder in windows format and not Linux. Where would this file be located in Linux?
at Dapper.SqlMapper.<QueryImpl>d__1361.MoveNext() in C:\projects\dapper\Dapper\SqlMapper.cs:line 1081
at System.Collections.Generic.List1.AddEnumerable(IEnumerable1 enumerable)
`

i assume postgres is on different host? have you check does it allow connection from miningcore host?

Does this work on the host where Postgres is running:
sudo -u postgres psql -d miningcore < createdb.sql

@21void - Postgresql is on the same host as Miningcore.

@oliverw
postgres@ultrapool:/home/ultrapool$ sudo -u postgres psql -d miningcore < createdb.sql bash: createdb.sql: No such file or directory

Still all the same errors.

So let's clarify things.

is postgres running on the same or different host that host miningcore
what is your config.json
what release of miningcore and postgres you are on

I went another pool backend until this project gets a MySQL support.

@RepoBike I remember @oliverw said database need to have ACID compliant, so MySQL support is not possible in foreseeable future since it isnt.

calvintam236 is there another DB that well work other than postgresql?

A bit late to the party but for future references this solution worked for me https://github.com/oliverw/miningcore/issues/294#issuecomment-377781189


Add a little something in the README about needing to install and boot up Mongo :D

.../mern-starter/node_modules/mongodb/lib/server.js:236
        process.nextTick(function() { throw err; })
Error: connect ECONNREFUSED
    at errnoException (net.js:904:11)
    at Object.afterConnect [as oncomplete] (net.js:895:19)

Obviously need to run mongod first. Could this be added in the npm start?

@beaucharman PR's,  welcomed!

Addressed in https://github.com/Hashnode/mern-starter/pull/35


[Bugfix] Fix for incorrect output labels from ml.rf_to_strings workflow

This PR contains as a bug fix to correctly label the classification results when serializing a random forest model to strings for later use on EE. This also contains some support to infer output mode of the user provided classifier as well as allow users to explicitly define the output mode (used when assigning the correct output labels).
Changes:

ml.py: updated value labels to be gathered from sklearn classifier and added checks for output mode

Example usage:

https://colab.research.google.com/drive/1WkqJ9mSY9Al4sRmJLdi2Ab4puafIe6BQ?usp=sharing

Closes #528

Looks good. Thanks for fixing the bug.


too slow if training custom corps

i have corps with 6000000 lines data , and i try to train the corps but it's too slow ,is there any ways to improve the performance in ChatterBot ?

Right now, no. Luckily training only has to be done once for a chat bot. You may encounter further issues once you finish training with that much data. I'm currently working on changes to solve performance issues for large data sets.

@aliray , if you don't mind can you please state where you acquired the data from?

Corps with 900000 lines data, use mongodb, super slow.

@laonan hello, have u solved the problem of efficiency. I meet the same problem

not yet, if u have any good news, would pls let me know? thx.

在 2017年9月30日，下午4:43，Lee Tao<EMAIL_ADDRESS>写道：
@laonan https://github.com/laonan hello, have u solved the problem of efficiency. I meet the same problem
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/gunthercox/ChatterBot/issues/908#issuecomment-333294204, or mute the thread https://github.com/notifications/unsubscribe-auth/ABYyVo7otDYXF_A6xGfCTk_Ht8Tfp13Yks5snf9OgaJpZM4OwNqn.

@laonan I have read the doc and asked the author. There is no good approach to efficiency and the author is working on it. The later version will get some changes and I may do some preprocessing before training to improve retrieve speed of response

Corps with 10000 lines data, use mongodb,
trainning once is acceptable.
But getresponse more than 2 second.
BestMatch get all 10000 lines and compute confidence each

I'm going to close this ticket off because as far as I can see there isn't any actionable items that can be done for it. For details on the planned performance improvements, please refer to #925.


Passing identical data into binders and getting different results

Hello, I'm working on an existing Shopify store and running into some issues with our rivets.js integration.
Take the following example that lives in an rv-each loop:

One would expect the output text and href values would be identical. Unfortunately, that is not the case:
rv-text => /products/clementine-hint%C2%AE-water-1?variant=31770173505639
rv-href => href="products/clementine-hint®-water"
the rv-text is accurate and yet rv-href is not. I've tried building an absolute path and experienced a similar result.
Please help me narrow this down to either a Shopify or Rivets bug and if possible, a solution. :)
I'm happy to provide more info if necessary. Thanks!

Closing this as we discovered some unexpected behavior with a 3rd party app we were using within Shopify causing this behavior. Appreciate the hard work on rivets.js!


TypeError: reduce_max() got an unexpected keyword argument 'keepdims'

Hi ,
Try to python cot.py
File "F:\study\EBGAN\CoT\Cooperative-Training\generator.py", line 57, in _g_recurrence
T_t = tf.stop_gradient(tf.reduce_max(-log_prob, axis=-1, keepdims=True))
TypeError: reduce_max() got an unexpected keyword argument 'keepdims'
Thonk you for your help

Please update your tensorflow to at least 1.6.0


[Feature] Add Cursor struct as part of request #121

This is an exploratory pr for request #121 and alongside with #188.

What about a full Input class?

@n77y Sorry for leaving this open for so long. I have decided in #121 that this is out of scope for the project so I am closing the PR. Still interested to see ideas like this in other projects though and appreciate the suggestion.


default calendar losing events between backend and front end

see
https://forum.magicmirror.builders/topic/18325/calendar-not-updating/85?_=1706893005707
I have added  traces to just before the socketsend from node helper and traces to the front end, and the event shows before send, and does not show after socket receive
the event is NOT at the start or end of the data
how else can I debug this?
we just did a new npm install, on 2.26, with<EMAIL_ADDRESS>

socketio uses json stringify before send, and parse on receive
my traces do the same..

closing , can't reproduce


erase option wipes SAMD21 protected bootloader, fuses

built from git source at 8202074d53ba666a7bbe9def780a9a9f78a4b140 on Linux
I am using SAMD21, I have a modified Arduino Zero bootloader in the first 8k, with BOOTPROT fuse set to cover first 8k:
0xFFFFFC5DD8E0C78A
After starting the bootloader, I run the bossa GUI.
If I set the 'erase all' option (no offset) and click 'write' then sometimes I get:

After the fail, bootloader is corrupted and all fuses are set to 1:
NVMUSERROW: 0xFFFFFFFFFFFFFFFF
I can recover by re-flashing bootloader and re-setting fuses with openocd and Atmel ICE programmer. But the reserved bits of the fuses are now always set to 1 and can't be changed:
NVMUSERROW: 0xFFFFFE5DD9FEC78A
I can repeat the exact same steps, but this time the write succeeds:

the bootloader and fuses remain intact.
It's difficult to say, but it seems maybe 1 in 20 times this will happen. Obviously I'd like to prevent it!
I don't know enough about SAM-BA - is it possible for SAM-BA to change fuses? I thought not.
I'm definitely open to the idea that this is a problem with the bootloader, perhaps overwriting itself and the fuses. But it is very close to the official Arduino Zero bootloader.

I've done some more investigation, and I think it must either be a chip problem or the implementation of SAM-BA on the Arduino Zero bootloader. I've opened an issue over there: https://github.com/arduino/ArduinoCore-samd/issues/417
And also talking to Microchip.

With no value set for "General Options: Flash Offset", I have effectively bricked a new SAMD21 development board for a project.
Having never had to set a value in earlier versions for this, I have found this out all tool late only to find here what the went wrong. No device found in /dev anymore for this device, no matter what I do.
It should be that some default value be set for Flash Offset or to at least warn a user that if no offset is set and that if any boot-loader is installed, that it is at risk of being over written ?
I don't have a JTag or SWD system to push the boot-loader back in, so am now stuck until I new board is shipped to me.
Also, the build instructions under GNU/Linux should state the necessary dependencies, libwxgtk3.0-dev and libreadline-dev. I had to search why the build was not happy. Please include this in the instructions for building. Being explicit is far better than making assumptions, from a users point of view.

Hello everyone, I have an issue and i thought maybe you could help.
Excuse me if the answer is on the above post and i just dont see it.
I have a feather M0 (non-express) board. I was trying to install circuitpy. In order to do this i had to install using bossac a (probably) uf2 bootloader to it from : https://github.com/adafruit/uf2-samdx1/releases. I am not really sure which one but it was a .bin file.
I tried using bossa GUI but i did the mistake mentioned above, i clicked erase all and forgot the offset. Since then the feather has its red led rapidly blinking and its unrecognised by the COM.
It only connects if i double click, but only for a brief second then it disconnects, making it impossible to use bossac to it. I have flashed the original hex bootloader using OpenOCD on raspberry PI zero W through SWD. Im back at the blinking led part.
What can i do?I appreciate all your help and thank you .

@dimostant
That blinking behavior indicates that you have successfully wiped fuse bits. effectively enabling WDT and force resetting the bootloader periodically.
Try flashing bootloader-feather_m0-v3.15.0.bin using OpenOCD. which has a feature to automatically fix wiped fuse bits.

I have to thank you so much! i solved my problem, which was to add circuit python!
However I should note some things because for someone trying to return to the original Arduino IDE its gonna be an issue.
I tried to install the binary you provided however as I mentioned only .hex files were running in the board ( and uf2's but they were buggy, at least the ones I tried ).
So what I did was convert it to .hex using :
objcopy -I binary -O ihex bootloader-feather_m0-v3.15.0.bin bootloader-feather_m0-v3.15.0.hex
in the raspberry. ( I moved the .bin file from windows to raspberry using winscp through ssh).
After that it didnt work so I used the .hex that was found in :
https://learn.adafruit.com/proper-step-debugging-atsamd21-arduino-zero-m0/restoring-bootloader
,the featherm0bootloader_160305.zip button.
I burned that with opeocd successfully and now the bootloader was working but it had a weird artifact.
In arduino IDE the feather m0 was show in two different COMS at the same time and ofc when I was trying to upload a sketch it wouldn't work. I pushed the red button twice and again the bootloader would appear for some milliseconds and then disappear again. Indicating the only difference ,since before using the new binary, being that it was showing up on the arduino IDE.
However that there was a 3rd COM when I pushed the red button twice ,to which I did the bossac i tried the first time , using the latest circuitpython for featherm0 basic binary. And Voilà. Circuit python runs properly.
How ever i dont know if reverting back to the original binary or hex will have the board working properly for the arduino IDE. I need the board for a project now, but i will try at my first convenience.
Thank you for your help again and I hope it helped in case someone needs this.


Give CMO TG members ability to post to https://github.com/riscv/riscv-CMOs/wiki

My initial work for the CMO TG was done on a GitHub wiki, and now lives in https://github.com/riscv/riscv-CMOs/wiki
I would like other members of the CMO TG to be able to edit the wiki - on the web page, in their browser, not just by cloning, editing offline, and sending me a pull request.
NOT globally readable.  Ideally just CMO TG members, but RISC-V mermbers more broadly okay.
Q: what is the best way to do this?  I.e. what is the way that RISC-V higher-ups prefer?
--
I would prefer not to spend a lot of time adding new members as they sign up.
AFAICT GitHub accounts will be required for such access. That's okay. Many members do not have GitHub accounts, but most can get them.
--
Perhaps we should just tell all CMO TG members to
a) get GitHub accounts
and ...
b) join the GitHub RISC-V organization https://github.com/orgs/riscv/people
and
c) join a GitHub team for the CMOs TG
which it looks easy enough to create - https://github.com/orgs/riscv/teams -- https://github.com/orgs/riscv/new-team - probably call it CMOs-members, to be consistent with the existing team CMOs-admins
I don't think that GitHub projects are relevant here.
--
I created this issue when I thought that I might require Stephano Cetola or other RISC-V higher ups to do it for me - but it looks like I can at least start the ball rolling using GitHub's request mechanism,.
Holding off, however, to give Stephano or others a chance to say
e.g. "don't bother creating a CMOs-members group - just let anyone who is a RISC-V GitHub organization member join."
TIMING: posting 9-28-2020 1pm --- will wait a day or so, for anyone to get back to me, and if no response, just do it as I describe above.
BTW, Stephano - please do NOT just do this yourself - if creating the CMOs-members group as above is okay, tell me, so that I can learn how to do it myself - or so that we can test if the DIY approach works.
TBD: my co-chair David Kruckemeyer should be an assignee for this issue - but he does not yet have a GitHub account :-)

TBD: my co-chair David Kruckemeyer should be an assignee for this issue - but he does not yet have a GitHub account :-)

I do have an account, but it's not clear to me yet how to take or share ownership of an issue....

Closed the wiki for now.


uORB: SubscriptionCallback cleanup naming

Can we come up with guidelines on formatting, variable_naming, methodNaming, etc.?

Can we come up with guidelines on formatting, variable_naming, methodNaming, etc.?

@julianoes yes I think it's time, there are far too many inconsistencies.
A lot of the google c++ style guide is close to where I think we want to be. https://google.github.io/styleguide/cppguide.html


[patch] upgrade dependencies

Description

change athenz org
upgrade dependencies
add scan

Type of change

[ ] Bug fix
[ ] New feature
[ ] Refactoring (no functional changes, no api changes)
[x] Non-code changes (update documentation, pipeline, etc.)

Flags

[ ] breaks backward compatibility
[ ] requires a documentation update
[ ] has untestable code

Checklist

[x] Followed the guidelines in the CONTRIBUTING document
[x] Added prefix [major]/[minor]/[patch]/[skip] in the PR title
[x] Tested and linted the code
[x] Commented the code
[x] Made corresponding changes to the documentation
[x] Confirmed no dropping in test coverage (by Codecov)
[x] Passed all pipeline checking
[x] Approved by >1 reviewer

Checklist for maintainer

[x] Use Squash and merge
[x] Double-confirm the merge message has prefix [major]/[minor]/[patch]/[skip]
[x] Delete the branch after merge

fixes #62, #63, #64


Add hardware requirements for setup Sedna and Examples

What would you like to be documented:
Add hardware requirements for Sedna and Examples.
Why is this needed:
Let users know the hardware requirements for setting up Sedna and each Examples.

link #30 .
We believe a image compression work is underway. Shall this issue be processed after that work completed?


Update to egui 0.23

Closes #118
Ran into troubles with egui 0.23 and current renet version, so tried to fix it this way.
I'm not aware of the details of renet internals, so maybe I forgot something - on the surface it seems to do the job though.
Took the time to update examples as well.

Can we get this merged please?

Would love to see this merged

Thanks!


How to create a production build for hosting with Air theme?

Could you please guide me on how to create a production-ready build of the Air theme to upload to my hosting? Previously, I used the Underscores Starter Theme and wanted to give your theme a try. I set up the theme using Dudestack and Laragon for local development.
Thanks in advance for your help!

We don't provide support for creating your own themes, but the README, wiki and docs (although a bit incomplete) should give you some hints. You can also use the theme without dudestack or any of the other setups we use and like just like in _s you just need to replace all occurrences of air-light to get started.

Hi,
Thank you for your response!
I think there was a bit of misunderstanding. I’m not looking to create a new theme or make modifications for theme development. I’m simply trying to build a website using the Air-light theme as the foundation. I liked the structure and minimalism of Air-light, and I want to use it for my personal or business site.
I’ve gone through the documentation several times but couldn’t find specific instructions on how to create a full production-ready build for deployment, apart from the parts that mention compiling JS and CSS via Gulp. I’ve set up the theme locally using Laragon and Dudestack, and now I’m looking for some guidance on how to properly prepare the theme for hosting after customization.
I’m not modifying the theme itself, just looking to deploy my customized site built on Air-light.
Thanks again for your help!

Hi,
Thank you for your response!
I think there was a bit of misunderstanding. I’m not looking to create a new theme or make modifications for theme development. I’m simply trying to build a website using the Air-light theme as the foundation. I liked the structure and minimalism of Air-light, and I want to use it for my personal site.
I’ve gone through the documentation several times but couldn’t find specific instructions on how to create a full production-ready build for deployment, apart from the parts that mention compiling JS and CSS via Gulp. I’ve set up the theme locally using Laragon and Dudestack, and now I’m looking for some guidance on how to properly prepare the theme for hosting after customization.
I’m not modifying the theme itself, just looking to deploy my customized site built on Air-light.
Thanks again for your help!


[SPARK-38823][SQL] Make NewInstance non-foldable to fix aggregation buffer corruption issue

What changes were proposed in this pull request?
Make NewInstance non-foldable.
Why are the changes needed?
When handling Java beans as input, Spark creates NewInstance with no arguments. On master and 3.3, NewInstance with no arguments is considered foldable. As a result, the ConstantFolding rule converts NewInstance into a Literal holding an instance of the user's specified Java bean. The instance becomes a singleton that gets reused for each input record (although its fields get updated by InitializeJavaBean).
Because the instance gets reused, sometimes multiple buffers in AggregationIterator are actually referring to the same Java bean instance.
Take, for example, the test I added in this PR, or the spark-shell example I added to SPARK-38823 as a comment.
The input is:
    new Item("a", 1),
    new Item("b", 3),
    new Item("c", 2),
    new Item("a", 7)

As ObjectAggregationIterator reads the input, the buffers get set up as follows (note that the first field of Item should be the same as the key):
- Read Item("a", 1)

- Buffers are now:
  Key "a" --> Item("a", 1)

- Read Item("b", 3)

- Buffers are now:
  Key "a" -> Item("b", 3)
  Key "b" -> Item("b", 3)

The buffer for key "a" now contains Item("b", 3). That's because both buffers contain a reference to the same Item instance, and that Item instance's fields were updated when Item("b", 3) was read.
This PR makes NewInstance non-foldable, so it will not get optimized away, thus ensuring a new instance of the Java bean for each input record.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
New unit test.

ping @AngersZhuuuu @cloud-fan

Merged to master and branch-3.3.


mmsd-tng: 2.6.1 -> 2.6.2

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/project/mmsd-tng/versions.
meta.description for mmsd-tng is: Multimedia Messaging Service Daemon - The Next Generation
meta.homepage for mmsd-tng is: https://gitlab.com/kop316/mmsd
Updates performed

Version update

To inspect upstream changes
Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 2.6.2 with grep in /nix/store/6cfjyxh3lb1165v37rmmwn5i2c03s209-mmsd-tng-2.6.2
found 2.6.2 in filename of file in /nix/store/6cfjyxh3lb1165v37rmmwn5i2c03s209-mmsd-tng-2.6.2

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath

mmsd-tng

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/6cfjyxh3lb1165v37rmmwn5i2c03s209-mmsd-tng-2.6.2 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A mmsd-tng https://github.com/r-ryantm/nixpkgs/archive/8a70db7dc9b8290b20c095107949acb19ea79004.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/8a70db7dc9b8290b20c095107949acb19ea79004#mmsd-tng

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/6cfjyxh3lb1165v37rmmwn5i2c03s209-mmsd-tng-2.6.2
ls -la /nix/store/6cfjyxh3lb1165v37rmmwn5i2c03s209-mmsd-tng-2.6.2/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
nixpkgs-review result
Generated using nixpkgs-review.
Command: nixpkgs-review

x86_64-linux

:white_check_mark: 1 package built:

mmsd-tng

Maintainer pings
cc @ju1m for testing.

[!TIP]
As a maintainer, if your package is located under pkgs/by-name/*, you can comment @NixOS/nixpkgs-merge-bot merge to automatically merge this update using the nixpkgs-merge-bot.

Add a :+1: reaction to pull requests you find important.

nixpkgs-review result
Generated using nixpkgs-review.
Command: nixpkgs-review pr 361344

aarch64-linux

:white_check_mark: 1 package built:

mmsd-tng


h02 device updates too frequent

Please help with a command to change the interval from 4 minutes at present to probably 20 minutes.
I set up cheap chinese tracker on Traccar, connected and works fine, but battery get drain quickly (last only 1 day), however on their GPS server, it last 10+ days with the frequency set 10 minutes.
Thanks in advance.
Sean

Forgot to add, that I set the device using SMS tim,20# received successful message but Traccar keeps pulling coordinates every 4 minutes - snapshot below.
2017-02-20 05:26:40 DEBUG: [311C83E6: 5013 < 203.x.x.147] HEX: 2a48512c363433303034363837342c4c494e4b2c3030323635322c37372c302c39382c302c302c3230303231372c464645374642464623
2017-02-20 05:29:57 DEBUG: [F6831DA9: 5013 < 203.x.x.157] HEX: 2a48512c363433303034313939342c4c494e4b2c3030333030392c3130302c302c39342c302c302c3230303231372c464645374642464623
2017-02-20 05:30:40 DEBUG: [311C83E6: 5013 < 203.x.x.147] HEX: 2a48512c363433303034363837342c4c494e4b2c3030333035322c37362c302c39382c302c302c3230303231372c464645374642464623
2017-02-20 05:33:57 DEBUG: [F6831DA9: 5013 < 203.x.x.157] HEX: 2a48512c363433303034313939342c4c494e4b2c3030333430392c3130302c302c39342c302c302c3230303231372c464645374642464623
2017-02-20 05:34:40 DEBUG: [311C83E6: 5013 < 203.x.x.147] HEX: 2a48512c363433303034363837342c4c494e4b2c3030333435322c37352c302c39382c302c302c3230303231372c464645374642464623
2017-02-20 05:37:57 DEBUG: [F6831DA9: 5013 < 203.x.x.157] HEX: 2a48512c363433303034313939342c4c494e4b2c3030333830392c3130302c302c39342c302c302c3230303231372c464645374642464623
2017-02-20 05:38:40 DEBUG: [311C83E6: 5013 < 203.x.x.147] HEX: 2a48512c363433303034363837342c4c494e4b2c3030333835322c37362c302c39382c302c302c3230303231372c464645374642464623
I tried on gps123.com (their GPS), the command 20 mins works fine, also the battery last very long.

Traccar does not "pull" coordinates. It receives coordinates with whatever interval device sends them.

Thanks for the prompt reply. Just so you know that I am still trying/testing as per manufacturer but still no luck. Will update you if any I found a fix.
Another question, not sure if I should ask under this subject, that;
how many devices it can receive coordinates and keep it as active at one time. I mean any barrier or performance issue under this 'open source' license?
BTW - its a great A++ product!
Thank you
Sean

There are no limits on number of devices. Traccar can easily handle tens of thousands of devices with proper server hardware.

Great! Your dedicate server version '50 devices is $50/month', if there are over 300 devices - just trying to understand your pricing because I am working on my client business needs.
Also,vif you can point me to best suitable Traccar compatible device type/model? I am testing rf-v8s but not happy with their battery time.
What we need;
-100 tracking device
-ideal wearable tech
-cost should be less than £50 ($60)
-coordinates shouldnt be 20mins plus intervals
-battery ideal time 5+ days
Any help on this would be highly appreciated.

Please send me an email to discuss it.