'Permission denied' when executing 'productAttributeAssign' from Apps

What I'm trying to achieve
I'm trying execute 'productAttributeAssign' mutation from App that has assigned the required permission 'MANAGE_PRODUCT_TYPES_AND_ATTRIBUTES' but I'm getting 'You do not have permission to perform this action'.
Not sure if this is intended behaviour - not allowing apps to assign attributes to product types, or just a bug.
Steps to reproduce the problem

Create third party app with permission 'MANAGE_PRODUCT_TYPES_AND_ATTRIBUTES' and obtain its token
Execute 'productAttributeAssign' mutation with obtained token

What I expected to happen
I expect to be able to execute 'productAttributeAssign' mutation from App that has assigned the required permission.
Screenshots and logs

{
   "errors":[
      {
         "message":"You do not have permission to perform this action",
         "locations":[
            {
               "line":3,
               "column":17
            }
         ],
         "path":[
            "productAttributeAssign"
         ],
         "extensions":{
            "exception":{
               "code":"PermissionDenied",
               "stacktrace":[
                  "Traceback (most recent call last):",
                  "  File \"/usr/local/lib/python3.9/site-packages/promise/promise.py\", line 489, in _resolve_from_executor",
                  "    executor(resolve, reject)",
                  "  File \"/usr/local/lib/python3.9/site-packages/promise/promise.py\", line 756, in executor",
                  "    return resolve(f(*args, **kwargs))",
                  "  File \"/usr/local/lib/python3.9/site-packages/graphql/execution/middleware.py\", line 75, in make_it_promise",
                  "    return next(*args, **kwargs)",
                  "  File \"/app/saleor/graphql/core/mutations.py\", line 336, in mutate",
                  "    raise PermissionDenied()",
                  "saleor.core.exceptions.PermissionDenied: You do not have permission to perform this action"
               ]
            }
         }
      }
   ],
   "data":{
      "productAttributeAssign":"None"
   }
}

Proposed solution
Replace 'check_permissions' class method with relevant 'permissions' field in 'Meta' subclass in 'ProductAttributeAssign' and 'ProductAttributeUnassign' which would make those mutation available to both users and apps, currently only users can execute them:
--- a/saleor/graphql/product/mutations/attributes.py
+++ b/saleor/graphql/product/mutations/attributes.py
@@ -50,12 +50,7 @@ class ProductAttributeAssign(BaseMutation):
         description = "Assign attributes to a given product type."
         error_type_class = ProductError
         error_type_field = "product_errors"
-
-    @classmethod
-    def check_permissions(cls, context):
-        return context.user.has_perm(
-            ProductTypePermissions.MANAGE_PRODUCT_TYPES_AND_ATTRIBUTES
-        )
+        permissions = (ProductTypePermissions.MANAGE_PRODUCT_TYPES_AND_ATTRIBUTES,)

     @classmethod
     def get_operations(cls, info, operations: List[ProductAttributeAssignInput]):
@@ -230,12 +225,7 @@ class ProductAttributeUnassign(BaseMutation):
         description = "Un-assign attributes from a given product type."
         error_type_class = ProductError
         error_type_field = "product_errors"
-
-    @classmethod
-    def check_permissions(cls, context):
-        return context.user.has_perm(
-            ProductTypePermissions.MANAGE_PRODUCT_TYPES_AND_ATTRIBUTES
-        )
+        permissions = (ProductTypePermissions.MANAGE_PRODUCT_TYPES_AND_ATTRIBUTES,)

I can have an PR ready asap if you think that's an acceptable solution!?
System information

Saleor version:

[X] dev (current master)
[ ] 3.0
[ ] 2.11
[ ] 2.10

Operating system:

[ ] Windows
[X] Linux
[ ] MacOS
[ ] Other

I'm having the same issue... any ETA on this fix?


"Save preferences" for "rodsadmin" user changes type to "rodsuser"

Hi,
we noticed that opening the "Preferences" page and pressing "Save" changes user_type_name from "rodsadmin" to "rodsuser"
Before:
[admin@server ~]$ iadmin lu User
user_id: 16818
user_name: User
user_type_name: rodsadmin
zone_name: testZone
user_info:
r_comment:
create_ts 2017-05-03.17:18:02
modify_ts 2017-06-30.14:14:29

After:
[admin@server ~]$ iadmin lu User
user_id: 16818
user_name: User
user_type_name: rodsuser
zone_name: testZone
user_info:
r_comment:
create_ts 2017-05-03.17:18:02
modify_ts 2017-06-30.14:15:58

This is metalnx-web 1.2.1.
regards, Andreas

What version of Metalnx are you using?

Until a moment ago I thought I was using 1.2.1. I build that from source and installed it (to fix the permissions bug we talked about)
But the "About" button still says "1.1.1-DEV"

You're right. There's a mistake on that. But, if you can, try to upgrade to 1.3.0 to see if the problem persists.

Yeah, I just noticed that you forgot to update pom.xml for version 1.2.0
I will build 1.3.0 now

Problem is still present in 1.3.0.
Please note that I changed irods.auth.scheme to PAM

I just set up an iRODS 4.1.10 instance and got an environment similar to yours: rods with STANDARD auth and another one using PAM. I went to the preferences page like you did, but there was no change on the user type. Can you walk me through the steps you made to double check if I hadn't missed something?

At start I make the user an rodsadmin
[mywtl@by-hcrdev2 ~]$ iadmin moduser eqogg type rodsadmin
[mywtl@by-hcrdev2 ~]$ iadmin lu eqogg
user_id: 16818
user_name: eqogg
user_type_name: rodsadmin
zone_name: testZone
user_info:
r_comment:
create_ts 2017-05-03.17:18:02
modify_ts 2017-07-04.14:15:41

Now I login as "eqogg". The user_type stays rodsadmin
[mywtl@by-hcrdev2 ~]$ iadmin lu eqogg
user_id: 16818
user_name: eqogg
user_type_name: rodsadmin
zone_name: testZone
user_info:
r_comment:
create_ts 2017-05-03.17:18:02
modify_ts 2017-07-04.14:15:41

I change to the dashboard (by editing the URL since I do not see a Dashboard link). Still rodsadmin
[mywtl@by-hcrdev2 ~]$ iadmin lu eqogg
user_id: 16818
user_name: eqogg
user_type_name: rodsadmin
zone_name: testZone
user_info:
r_comment:
create_ts 2017-05-03.17:18:02
modify_ts 2017-07-04.14:15:41

Now I change to "Preferences" and press "Save"
[mywtl@by-hcrdev2 ~]$ iadmin lu eqogg
user_id: 16818
user_name: eqogg
user_type_name: rodsuser
zone_name: testZone
user_info:
r_comment:
create_ts 2017-05-03.17:18:02
modify_ts 2017-07-04.14:16:27

Odd. Even on a fresh installation you didn't see the dasboard page coming up? It should be the first page a rodsadmin sees as soon as he's logged in.

No, what comes up it the "Collections" page.

Can you capture the tomcat logs right after you click on "Save" on the preferences page and post it here?


feat: create pull request

Description

Screencast

Checklist

[x] I read the extension guidelines
[x] I read the documentation about publishing
[x] I ran npm run build and tested this distribution build in Raycast
[x] I checked that files in the assets folder are used by the extension itself
[x] I checked that assets used by the README are placed outside of the metadata folder

Hi @dengshenkk 👋
What is this, seems to be something unfinished?

你好@dengshenkk 👋
这是什么，似乎还有什么未完待续的事情。

it's done

Looks like it's something similar to Bing Wallpapers in the store, or?

ok, I didn't know there was an identical extension. close it


Is it possible to execute a query for every connection in a pool?

To disable MySQL's autocommit, I'm executing the following query every time a connection is established:
SET autocommit = 0

However, I couldn't find a way to manually commit the data on ending the connection. When I'm not using a connection pool, I can simply run the query before calling connection.end(). I looked through the library source code and it seems there is no end event or something like that.
Is it possible to execute a query for every connection in a pool before disconnecting?

By "before disconnecting", do you mean you want to run this when you call pool.end() or something else?

Something like this. I'd like to run COMMIT for every connection, just before calling pool.end(). I guess if there was a way to iterate over all connections, I could do that.
Thanks for the fast reply, BTW.

Gotcha. One problem with that is a connection can drop off at anytime while it is idling in the pool, and so if you put the connect back into the pool without committing first, then you can silently loose anything done over that connection. Connections can drop due to network issue, server idle timeouts, etc.


Declaration map d.ts.map files do not match transformed d.ts files

Describe the bug
I found that d.ts.map does not match d.ts file after some transformations from vite-plugin-dts.
It leads to issues with debugging and navigation in IDE.
Original (after tsc):
https://stackblitz.com/edit/vitejs-vite-jeijwx?file=tscdist%2Fb.d.ts
Transformed d.ts (after vite-plugin-dts):
https://stackblitz.com/edit/vitejs-vite-jeijwx?file=dist%2Fb.d.ts
And d.ts.map are the same
https://stackblitz.com/edit/vitejs-vite-jeijwx?file=dist%2Fb.d.ts.map
https://stackblitz.com/edit/vitejs-vite-jeijwx?file=tscdist%2Fb.d.ts.map
Reproduction
https://stackblitz.com/edit/vitejs-vite-jeijwx?file=dist%2Fb.d.ts
Steps to reproduce
No response
System Info
System:
    OS: macOS 14.5
    CPU: (8) arm64 Apple M1 Pro
    Memory: 83.36 MB / 16.00 GB
    Shell: 5.9 - /bin/zsh
  Binaries:
    Node: 20.9.0 - ~/.nvm/versions/node/v20.9.0/bin/node
    Yarn: 1.22.19 - /opt/homebrew/bin/yarn
    npm: 9.8.1 - /opt/homebrew/bin/npm
    pnpm: 8.6.10 - ~/Library/pnpm/pnpm
  Browsers:
    Chrome: 126.0.6478.185
    Safari: 17.5
  npmPackages:
    @vitejs/plugin-react: ^4.0.0 => 4.0.3
    vite: ^4.1.5 => 4.1.5
    vite-plugin-dts: ^4.0.0-beta.1 => 4.0.0-beta.1

Validations

[X] Read the FAQ.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] The provided reproduction is a minimal reproducible example of the bug.

I started working on fixing the particular issue with an extra new line, but it is not a solution for the issue in general.  https://github.com/beda-software/vite-plugin-dts/tree/patch-356
The transformation that vite-plugin-dts makes, might change d.ts file significantly, so, maps files won't be accurate in some cases.


Refactor element props to renderProps

Today we accept elements as props so that we can add classes, event handlers, etc. like so:
<Button icon={star}>Click</Button>

A more extensible and future proof solution is to convert this pattern to renderProps:
<Button icon={({isFocused}) => {isFocused ? 'star' : 'favorite'}>Click</Button>

renderProps gives a lot more control to the user, while still allowing our components to do the work for them. The downside is that the user will have to be aware of these features (adding classes, adding event handlers, etc.), and add them to their rendered element.

Closing since this isn't a pressing issue with the components


Running locally

Hi, I've been trying to run this repo locally and to do so I've made the following steps:

create a .env file with DATABASE_URI for a local postgres db.
add const dotenv = require("dotenv"); dotenv.config(); to the beginning of addons/index.js
run database.sync({ alter: true }); from Sequelize after defining the models on addons/lib/repository.js.

The server seems to startup nicely, I am able to add the local running addon to stremio, but I never get any result for any movie/serie/anime.
I tried running both the catalogs and addons but the result seems the same.
I though that the database would get populated automatically when no hash was found, did I assume wrong?
Could you shed some light on what I should be doing to make this work?
Thanks

Hi, database is populated by a different process, which periodically scrapes various providers for new torrents and indexes them. This code is not part of this repo due to dmca concerns.
This whole repo/idea is architectured to be an efficient remote addon/api. It's not really meant to be run locally.


[documentation] Ktlint site installation instructions

I'm trying "bug" but perhaps this is "enhancement".
I see the announcement of 1.0.0 release of ktlint (https://github.com/pinterest/ktlint/releases/tag/1.0.0)
My current Maven builds use 2.0.0 for ktlint-maven-plugin from GantSign (John Freeman - @freemanjp).
Perhaps the GitHub README.md and the Ktlint site might give some prominent quick "getting started" instructions at the top when devs land on these pages?
(Ktlint site has a side bar that leads to instructions, but a prominent link or "getting started" would answer the first question all devs have.)
You might also consider pointing folks to the Maven plugin for those folks using Maven, in addition to the Ant instructions. Something like you do for Gradle with @jlleitschuh plugin.

README.md and home page should contain links to:

Get started with Ktlint CLI
Third party integration

For third party integration not detailed instruction are added as we are not in control of those integrations. So only a link to the documentation of the integration is allowed.


[1.11.2] Network Controller goes dead after leaving the area

Issue description:
I have a simple RS setup that connects a controller, grid, and crafting grid to external storage.
What happens:
When a player leaves the area and comes back, the controller is dead.   It needs to be broken and replaced, then everything works fine
What you expected to happen:
Not go dead
Steps to reproduce:

Setup controller and crafting grid
leave the area (via /tp or other method
return to the area
...

Version (make sure you are on the latest version before reporting):

Minecraft: 1.11.2
Forge: 2304
Refined Storage: refinedstorage-1.4.10.jar

Does this issue occur on a server? [yes/no]
Yes
If a (crash)log is relevant for this issue, link it here:
No crash
[pastebin/gist/etc link here]

Define dead. Does the controller still blink, are the devices still connected, ...?

The controller, grid, and crafting grid go dark and nothing works.

With a chunk loader, it does not go dark

Logging out from the server in front of the RS system and logging back in results in the system going dark

If you open the controller GUI what does it look like?

It shows full power and everything connected, still dark

Of course I cannot reproduce this bug!
Before...

And then, rejoin! Result:

Any relevant logs like exceptions when this happens?

Same problem, but when i relog, controller is blue, full powered, i can pull out items but autocrafting is not working. I have to replace controller to make it work again.

Define "not working", please..............

Raoul,
Are you testing with the creative controller or the regular?   My problem seems to occur with the regular one that needs power.
I have tried several different power sources and the controller is dark when I leave and return.  Looking inside the controller GUI shows plenty of power stored up.
I am using a custom modpack I created: https://minecraft.curseforge.com/projects/pughland-plethora
Also, when I leave a chunkloader on in the area, the controller is still dark when I return.
There are no relevant messages in the server log during the time of leaving/returning to the area.

I can see in grid that i can craft Cable for example, but when I send order to make some of them, literally nothing happens. Crafting monitor is empty, no scheduled tasks.

Just a quick note for now; I am having the same problem. Whenever I leave the area (e.g. go to the nether and return) the controller is either not powered (no lights) and nothing works, OR the controller still works (lighted) but the grid (inventory) shows as empty (grayed out). breaking the controller and replacing it fixes it. I am currently not home, but will post more info, inc. a log/mod-list if relevant either tomorrow or Wednesday.

hmm, seems this is a forge issue. Updating to 2314 resolves the issue; I was on 2290 before.

Good to hear!

Nope, I spoke too soon. Today I went back and forth between my two bases and sometimes it does happen (controller not powered, replacing it solves it), and sometimes it doesn't. It seems to be related to the amount of time I am gone?
There are no entries in the log related to refined storage. Here is a list of mods.

II updated to Forge 2314, and nothing changed.   Same behavior as Ash70 described.

I'm also having the same problem, it seems that just chunkloading the machine isen't enough. This also happens with wireless receivers, when I'm not close to them.

Just an update on my problem, I found that the problem disappereared when I used persistent bits instead of FTBUtils to do my chunk loading. The two things might not be releated, but it atleast fixed the issue for me.

I have the same problem using Refined Storage 1.4.17
Whenever I unload the chunk my RS system is in either by walking far enough away, teleporting or switching dimensions you can no longer access items in it when you return. It acts as if their is no power even though the controller is still lit up and everything is powered.
In order to get it working again I have to break the controller and replace it.
My setup: http://i.imgur.com/HSHeXKX.png

Any logs when this happens?

@raoulvdberge Not that I'm aware of since the game doesn't crash.
Though I did create a new world and have no problems with RS when unloading chunks. So I'm hoping it was just that world. Guess I'll have to wait a few days and see if the problem reoccurs.

You can still have logs, even if the game doesn't crash.

@raoulvdberge Correct but I wouldn't know what to send you. Not only was my log overwritten when I created a new world but the logs are full of generic information and searching for anything related to Refined Storage just showed typical loading messages.
If you can point me to a specific file or a general area to look for any relevant information I'd be happy to send you more data but at the moment it looks like just a fluke with that world save so I'm not sure there is any useful data to send you.

I don't think either.

Unfortunately I wanted to add some logs to maybe assist but as so far I have one user with this issue.  Right now I have about 4 users with ae2 Me systems and about 4 with RS systems.  This is on a FTB Beyond Pack(v1.10b) on a server.  I did some testing on mine and was able to spread out the grids and such pretty far with no issues. The one player having issues I had them use manipulator and put all items on new disks, break all old rs items and trash them(as well as cables, and had them completely redo with all new items.   The issue is still present.  No other storage systems are  are affected(ender storage, me, etc) and I can not reproduce.   If there is any logs I can provide you other than the ones I already have let me know. I'll do what I can to help.
I could not find anything relevant  but maybe it will help you:
Latest-Client-log

I'm using version 1.5.6 in MC 1.12. The issue im having is if you leave the area where the refined storage  (controller,grid,and disc drives) is and the chunk unloads, when you return it will be lit up(blue) but you can not put in anything in it and there are no items showing. If you then break the controller and replace it everything is fine. So chunk unloading = controller losing connection to network. To recreate the issue I would suggest going to another dim like the nether and coming back.
Also there is an issue when placing cables and the rendering of them connecting to other cables. If you relog sometimes it will fix the issue.
mc: 1.12
refined storage: 1.5.6
modpack: All The Mods 3
forge: 2387

@DingoX3
That was the exact issue I had on 1.10.2 but it was only on one world. I couldn't replicate it after and had no relevant data in the logs.

We actually tested it with one person in console looking at the fml logs and console logs and me on the server going back and forth to the nether to cause it to disconnect or stop working. There were no relevant logs that showed up during this test.

@raoulvdberge I have a very similar possibly exact issue, however everything remains lit up an connected, but when i open crafting grid no items for me appear until such time as i remove a storage drive an replace it. My area is supposed to be chunkloaded, but occurs reguardles

The issue with the items not showing up has been fixed.
However, I still can't reproduce the "controller going dark" issue...

Ive not been able to trigger this issue either no matter which way I try an do it

Me neither, I guess some people confused this bug for the items not showing up issue.
Closing


Upgrade/800/sas logical interconnect

Description
Updated SAS Logical interconnect resource module to support OneView API version 800
Check List

[x] New functionality includes testing.

[x] All tests pass. ($ ./build.sh).

[ ] New functionality has been documented in the README if applicable.

[x] New functionality has been thoroughly documented in the examples (please include helpful comments).

@jyothis-gireesan , @dileepds , worked on the comments, please have a look.


Feature Request

Support for mathjax?

@zhoubin-me similar to our answer here, you can implement your own custom Mathjax tag and support it in Markdoc apps 🙂


add profile in data.json

Hey @JhoanAlvear
Your PR does not follow contribution guidelines.
Your PR must have at least 5 bookmark links.


Adding more contrast/color to the sidebar icons.

I'm starting to use Station and really love it, thanks!
However I find the sidebar very unusable at the moment. The contrast for icons that are not active makes them difficult to differentiate from another:

I'd suggest two options (with quick and dirty previews ^^)
• making the contrast higher : darker blue background and brighter/whiter symbol

• or having colored icons for each app, and making the active app's icon bigger, or circled with a thicker white line to differentiate it

Thanks for your attention

Bumping this. Sidebar shouldn't be distracting, but should be usable without a magnifying glass. Icons are iconic for a reason. I recognize logos from a mile away!
Color would make this super helpful!

hi, I am moving out from Ferdium, Station looks like good alternative, but this is exactly issue what I have - I need to have color icons. Now I dont know which app is which one, with color icons I can be 2-3 times faster between switching applications. Please add it.

Yeah, bumping this. Station is great but the side bar is so tiny, and bummer I can't choose my own colours for the background and icon styling. Probably not relevant but the minimise, close, and full screen buttons on Mac are smaller than all other Mac apps.

It would be nice to allow the sidebar to be themeable. I use blue sparingly, because certain blue lights mess with my eyes. For me, this makes the sidebar hard to see. Only sort of theming I've seen is for icon color when making a custom addition, but that doesn't seem to be something you can change after you initially set it.


Add new field for Funding Status

We need a field that tracks the status of funding.

We can put this in the Project Details page
titled "Funding Status"
with the drop down options of: Granted, Planned, Rejected

Run through user group to see what to name/call the values perhaps "not funded" instead of "rejected"


Flash plugin

Flash doesn't work in Chromium even after installing pepperflashplugin-nonfree. It is depricated, replaced by adobe-flashplugin.  Needs to have Canonical Partners allowed in Software & Updates
See https://wiki.ubuntu.com/Chromium/Getting-Flash

I made a pull request that might fix this. Can we try testing this out during build?

Of note: When you put 'fixes #issuenumber' in a commit, the associated issue will automatically be closed when you merge the pull request the commit is in. https://help.github.com/articles/closing-issues-using-keywords/


Adding Terms and Conditions in footer

@notsoocool
In the footer, there is no option for Terms and Conditions, I want add a option for it, so that when we click it, Terms and Conditions page will be opened
I would like to work on it
Could you please assign it to me

@AswaniBolisetti kindly open separate PR for each issues


Inactive table resize and scrollable

The frog does not drink up the pond in which he lives.

"I am not afraid of an army of lions led by a sheep; I am afraid of an army of sheep led by a lion." - Om


[strong] Switch to iojs 1.5 and use new features

io.js v1.5 has a newer version of V8. The following features are now
kept in bin/traceur.js:

block binding (let, const, functions in block)
template literals
numeric literals
generators
for of

This also changes the required version in package.json and .travis.yml.
Make sure you nvm install iojs.

@rossberg-chromium PTAL
@domenic FYI
Can't wait for iojs to get classes

w00t w00t. And indeed, classes soon!!


Name Consistency and Update web urls in Web-UI

Update the link of documentation https://singa-auto.readthedocs.io/en/latest/src/user/quickstart.html
Update web url links to https://github.com/nusdbsystem/singa-auto
keep consistency of SINGA-auto name in web-UI to this repo]

may go to the deployed site to take a look http://panda.d2.comp.nus.edu.sg:65432/

Before Table Alignment:

After Table Alignment:


Add version v6.10.0

Checklist

[x] Used a personal fork of the feedstock to propose changes
[x] Bumped the build number (if the version is unchanged)
[x] Reset the build number to 0 (if the version changed)
[x] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[x] Ensured the license file is being packaged.

@conda-forge-admin, please rerender

@marcelotrevisani please review when possible. Thank you.


Replace kotlin synthetic with viewBinding

Read an article that kotlin synthetic will be deprecated in the next kotlin release, I will like to integrate viewBinding into this project.
Reference:https://www.reddit.com/r/androiddev/comments/jetvoa/kotlinandroidextensions_plugin_will_be_deprecated/?utm_source=share&utm_medium=ios_app&utm_name=iossmf

Very glad to know that kotlin synthetic will be deprecated and look forward to review your pr 😀

checkout my pull request

Thx!


C++ example (program executor) fails for larger programs

The example is distributed wit a tiny ASM program. Both - the CPP and Rust examples execute it with no issue.
However when running some larger programs (I tested with C64 Kernal) the CPP example seems to jump occasionally to wrong addresses. The error never occurs at the same address. It feels like it may be related to write function, that doesn't guarantee sending entire buffer at once. Anyway, further investigation is required. The Rust example can run Kernal with no issue, so the problem is specific to C++ code only.

Implementing #11 will help to debug this problem, so I am going to start there.


Binance live trading doesn't work

Note: this is the technical bug tracker, please use other platforms for getting support and starting a (non technical) discussion. See the getting help page for details.
I'm submitting a ...
[x] bug report
[ ] question about the decisions made in the repository
Action taken (what you did)
The function this.getFee(_.noop) inside binance.js doesn't start live trading with binance
Expected result (what you hoped would happen)
Start binance trading
Actual result (unexpected outcome)
Binance trading fails
Other information (e.g. detailed explanation, stacktraces, related issues, suggestions how to fix, links for us to have context, eg. stackoverflow, etc)

That function is not supposed to start live trading.
Is there an error or a reason why you think live trading is not starting?

I did now see that this function throws an error when running a paper trader (which is not trading, but simulating). You can get the latest develop version that includes a fix, see here. Let me know if that was the problem you were trying to describe.

Also have an error at Binance with tradebot. It buys some coins and crashes with the following error:
Jul 24 08:05:21 ip-172-31-31-32 gekko[9465]:   --> POST /api/getCandles 200 274ms 3.45kb
Jul 24 08:15:19 ip-172-31-31-32 gekko[9465]: RECEIVED ERROR IN GEKKO INSTANCE 2018-07-24-06-53-tradebot-59108201058719
Jul 24 08:15:19 ip-172-31-31-32 gekko[9465]: { __augmented: true }
Jul 24 08:18:26 ip-172-31-31-32 gekko[9465]:   <-- POST /api/getCandles
Jul 24 08:18:26 ip-172-31-31-32 gekko[9465]:   --> POST /api/getCandles 200 275ms 3.86kb
I'm running 0.6.3 UI

Switched to develop version, error is different now:
Jul 24 09:17:00 ip-172-31-31-32 gekko[11935]: 2018-07-24 09:17 Gekko 2018-07-24-09-17-watcher-512706268282978 started.
Jul 24 09:17:00 ip-172-31-31-32 gekko[11935]:   --> POST /api/startGekko 200 17ms 1.23kb
Jul 24 09:17:01 ip-172-31-31-32 gekko[11935]:   <-- POST /api/startGekko
Jul 24 09:17:01 ip-172-31-31-32 gekko[11935]: 2018-07-24 09:17 Gekko 2018-07-24-09-17-papertrader-3099666194555426 started.
Jul 24 09:17:01 ip-172-31-31-32 gekko[11935]:   --> POST /api/startGekko 200 6ms 1.82kb
Jul 24 09:17:01 ip-172-31-31-32 gekko[11935]: RECEIVED ERROR IN GEKKO INSTANCE 2018-07-24-09-17-papertrader-3099666194555426
Jul 24 09:17:01 ip-172-31-31-32 gekko[11935]: { code: 'MODULE_NOT_FOUND' }

Now,  the issue is fixed with the latest develop version.
Thanks

:+1:


Using contigs rather than reads

Hi,
This is follow-up to twitter conversation with @PeroMHC.
Is the following workflow available in Paladin?
(1) Find ORF in assembled contigs
(2) map amino acid sequences to reference database
(3) The use read to contig mapping information (in SAM/BAM file) to estimate abundance of amino acid sequences per sample?
Cheers,
Ameet

It is interesting to consider and assemble-first workflow application.  I assume there is no problem to use the predicted proteins as "reads".  Supporting the use of predicted proteins would potentially enable a lot of comparative genomics.

As PALADIN stands right now, it has most of the internal mechanisms to accomplish #1 and #2 above ( #3 would be an addition but a very quick/easy one).  However, because of the way we are currently implementing ORF detection and post-alignment filtering, any genes present in the same contig but in a different reading frame (from the frame with the total best aligned genes on that contig) would be lost after alignment, so depending on the genomes, gene density, and contig lengths in question you would only get partial results using version 1.0.0 - though feel free to experiment and give us any feedback.  A full version is definitely doable (and without too much effort, barring unforeseen issues).  I'll mark this as an enhancement and keep it open, thanks for the questions/suggestions Ameet!

Thanks!

I'd also be very interested in such a workflow – just an FYI (and as a sign of demand). 😉

To be tested, but using "-f 0" should accomplish this (which turns off ORF processing all together).  Closing for now


DB::Exception Cannot find column in source stream (prewhere + Engine=Merge)

ClickHouse client version 18.12.17.
Connecting to localhost:9000.
Connected to ClickHouse server version 18.12.17 revision 54407.
create table ttt_1(a Int64, b Int64) engine=MergeTree partition by a order by tuple();
insert into ttt_1 select number%2,number from numbers(100);
create table ttt_merge as ttt_1 engine=Merge(currentDatabase(), '^ttt');

select count() from ttt_merge prewhere a = 0;

ClickHouse exception, code: 8, host: chdw1-1.sde479.mycmdb.net, port: 8123; Code: 8, e.displayText() = DB::Exception: Cannot find column a in source stream, e.what() = DB::Exception [DB Errorcode=8]
1 statement failed.

create table ttt_1(a Int64, b Int64) engine=MergeTree partition by tuple() order by a;
insert into ttt_1 select number%2,number from numbers(100);
create table ttt_merge as ttt_1 engine=Merge(currentDatabase(), '^ttt');

select count() from ttt_merge prewhere a = 0;
DB::Exception: Cannot find column a in source stream

create table ttt_1(a Int64, b Int64) engine=MergeTree partition by b order by a;
insert into ttt_1 select number%2,number from numbers(100);
create table ttt_merge as ttt_1 engine=Merge(currentDatabase(), '^ttt');

select count() from (
select * from ttt_merge prewhere a = 0 and b=0 limit 100);
DB::Exception: Cannot find column b in source stream

#3165 fixes this problem.
BTW. Using _table virtual column in prewhere is not allowed

notes for me:
worked  in 18.6.0
fixed in 18.14?


Vincent Shields Copyright Waiver

I dedicate any and all copyright interest in this software to the public domain.  I make this dedication for the benefit of the public at large and to the detriment of my heirs and successors.  I intend this dedication to be an overt act of relinquishment in perpetuity of all present and future rights to this software under copyright law.

Hi @markjoshwel
Thank you so much for allowing me to make contributions and for giving me feedback. I am really grateful that you got back to me so quickly. Let me know if I did something wrong here! Also, I will get going on the other docstrings you mentioned in issue #3. Thank you very much!

Hi @markjoshwel
Thank you so much for allowing me to make contributions and for giving me feedback. I am really grateful that you got back to me so quickly. Let me know if I did something wrong here! Also, I will get going on the other docstrings you mentioned in issue #3. Thank you very much!

Absolutely no problem, @vlshields! Thanks a bunch for contributing to tomlantic — it means a lot to me!


Resolve the profile level issue due to FrameRate configuration in encoder

Media TC: testProfileAvcBaselineLevel1 is failed with incorrect level error due to FrameRateExtN is not configured with the TC config value.
Remove the else condition from the kParamIndexFrameRate switch case as every valid framerate is considering as failure case and FrameRateExtN is not getting configuring with the TC configration.
Tracked-On: OAM-105719
Signed-off-by: gollarx<EMAIL_ADDRESS>

Reviewers: @basilchew

Is there plan to port this to horizontal?

Is there plan to port this to horizontal?

Hello Basil,
Yes, need to raise Horizontal PR as well.

Ok, please submit and link to OAM-105719

PR#32 already merged. this can be closed.


Can I use your model to estimate relative depth estimation ?

I want to train your model on my own dataset, which has RGBA images + relative depth maps( 8-bit)
Is this possible ?
Here is an example of my data:
RGB Image:

Ground truth depth map ( 8 bit):

Thanks in Advance !

I think the original model (Depth Anything) is a better starting point for this task

I've tried Depth-Anything-V2 and gives metric depth. What I want is relative depth. But if you mean their original model, there is no training code for it ^^ and am a beginner I can only fine-tune things.

The base version should be trained for relative depth estimation. If you would like to fine-tune the base model, you can use my code: I have fine-tuned their small and base versions.


Update create-a-phone-system-auto-attendant.md

Removing reference to the requirement of having a "phone license" to be part of the dial by name/number scope of the auto attendant as this is no longer required.

@JohanFreelancer9 Copy editing is needed for this PR. Thanks.

@MikePlumleyMSFT PR has been copyedited and is ready for final review, could you please check and merge? Thanks!


Applied fixes from StyleCI

This pull request applies code style fixes from an analysis carried out by StyleCI.

For more information, click here.

Coverage decreased (-0.2%) to 83.582% when pulling 4a62162b9f5f1a52abc308ad37711974ba5bcb5e on analysis-qrrMNV into effe4e964afc934d2f19bfd8cf527c354c74a223 on master.


Visual glitch during shared transition

Hi! Could you please have a look at this snack: https://snack.expo.io/@jveres/algolia+recyclerlistview_optimised
There's a noticeable glitch at the bottom during shared transitions.
What am I doing wrong here?
Great library, btw!

Hi @jveres! Thanks for the example. I'm having some issues getting your snack to run properly, but was able to copy it locally and test for my self. Did not get the images to load, but I could see the issue you are referring to and will see if I can create a simpler repro that would be easier to debug.

It's strange that images are not loading on your side :(
It always worked for me so I have no clue - anyway, I think you can just use whatever square image source which works for you in App.js lines 95 & 250. It should then render that image and you can watch transition animations.

Images might not be necessary, the problem doesn't seem the be image, but the bottom part, right?

Correct. The problem occurs where I use appear="bottom" in the following code:
const DetailsScreen = ({ navigation }) => {
  const { params } = navigation.state;
  const { item } = params;
  return (
    <View style={{ flex: 1, padding: 20, backgroundColor: 'white' }}>
      <ScrollView>
        <Transition shared={item.image}>
          <Image
            style={{
              width: SCREEN_WIDTH - 40,
              height: SCREEN_WIDTH - 40,
            }}
            source={{ uri: item.image }}
          />
        </Transition>
        <Transition appear="bottom">
          <View
            style={{
              flex: 1,
            }}>
            <Text
              style={{
                fontSize: 20,
                fontWeight: 'bold',
                paddingBottom: 5,
              }}>
              {item.name}
            </Text>
            <Text
              style={{
                color: '#162331',
                fontSize: 16,
                fontWeight: '200',
                paddingBottom: 5,
              }}>
              {item.type}
            </Text>
            <Text
              style={{
                fontSize: 15,
                fontWeight: 'bold',
                paddingBottom: 5,
              }}>
              ${item.price}
            </Text>
            <View
              style={{
                paddingBottom: 5,
                flexDirection: 'row',
                alignItems: 'center',
              }}>
              {Array.from({ length: 5 }).map((_, index) => {
                return index < item.rating
                  ? <StarF width={16} height={16} color={'orange'} />
                  : <Star width={16} height={16} color={'orange'} />;
              })}
              <Text style={{ fontSize: 15, paddingLeft: 5, color: 'gray' }}>
                ({item.rating})
              </Text>
            </View>
          </View>
        </Transition>
      </ScrollView>
      <Transition appear="bottom">
        <View>
          <TouchableOpacity
            style={{
              height: 60,
              borderWidth: 1,
              marginTop: 20,
              justifyContent: 'center',
              alignItems: 'center',
            }}
            onPress={() => navigation.goBack()}>
            <Text>Back</Text>
          </TouchableOpacity>
        </View>
      </Transition>
    </View>
  );
};

this works:
const customTransition = transitionInfo => {
  const { start, end, boundingbox, dimensions } = transitionInfo;
  const { y, height } = boundingbox;
  const distanceValue = dimensions.height - y + 25; // instead of: - y - 25;
  const progress = transitionInfo.progress.interpolate({
    inputRange: [0, start, end, 1],
    outputRange: [distanceValue, distanceValue, 0, 0],
  });
  return { transform: [{ translateY: progress }] };
};

Great that you found a solution. From the tests I ran I also saw that there might be a problem with the layout you are working on, but I didn't have the time to find out wether it was the Fluid Transitions library that failed or your layout.

Actually just copy pasted FluidTransitions/src/Transitions/getBottomTransition.js and modified at line 9:
const distanceValue = dimensions.height - (y + 25);

in order to circumvent the initial 25dp offset what made the layout visible.


Missing images in Epub3 and changeFontFamily

Hi need some help can't seem to load images in Epub 3 it only loads Epub2 and the how to use changeFontFamily function implementation is not clear not example exists

You can use it this way:
import * as React from 'react';
import {
  SafeAreaView,
  text,
  TouchableOpacity,
  useWindowDimensions,
  view,
} from 'react-native';
import { Reader, ReaderProvider, useReader } from '@epubjs-react-native/core';
import { useFileSystem } from '@epubjs-react-native/file-system';
import { styles } from './styles';

function Inner() {
  const { width, height } = useWindowDimensions();
  const { changeFontFamily, changeFontSize } = useReader();
  return (
    <SafeAreaView style={styles.container}>
      <View style={styles.options}>
        <TouchableOpacity onPress={() => changeFontFamily('cursive')}>
          <Text>Change FontFamily</Text>
        </TouchableOpacity>

        <TouchableOpacity onPress={() => changeFontSize('10px')}>
          <Text>FontSize small</Text>
        </TouchableOpacity>

        <TouchableOpacity onPress={() => changeFontSize('36px')}>
          <Text>FontSize big</Text>
        </TouchableOpacity>
      </View>

      <Reader
        src="https://s3.amazonaws.com/moby-dick/OPS/package.opf"
        width={width}
        height={height * 0.7}
        fileSystem={useFileSystem}
      />
    </SafeAreaView>
  );
}

export function CustomFont() {
  return (
    <ReaderProvider>
      <Inner />
    </ReaderProvider>
  );
}

The changeFontFamily method only accepts webSafe fonts (https://www.w3schools.com/cssref/css_websafe_fonts.php)

Thanks you so much for the above reply now having one issue with the images in epub3 , it displays well with other pubs but epub3 images are not shown

Can you provide the epub?

Thanks this the Epub
https://rhapsodyofrealities.b-cdn.net/app/books/epub2024-april.epub
most of our epubs are in this format epub3

hello @paulNIP i'll take a look

hello @paulNIP i'll take a look

Hi Hope you are doing well is there any feedback on that epub rendering images

Done

@paulNIP I'm currently working on other things that keep me from focusing on this, so I'll work on your request as soon as possible!


Change the shade of Dark Theme

I would like to change the shade of dark theme. The Current dark theme is too much bright.
Kindly assign this to me!!

Please share some screenshots of after edits for better understanding @Ritika122001 .


Consuming GeoJSON from secure API (token-based)

I am planning to use the url for a GeoJSON layer to consume data generated by an API. However, the API uses token authentication. Is it possible to specify the HTTP headers for the URL request?
I guess I can just pull the data and pass it as data instead of the url, but I just wondering about that option.

Hey @jajberni, could you add an example of what the headers would look like in your use case even if with a mocked token?
The reason is we are working on securing our WMS server and we'll eventually need similar functionality added to the dash-leaflet WmsTileLayer.

Sure!
Here is my code to get the geojson from the API
api_endpoint = settings.API_BASE_URL + f'/fields/{field_id}/geojson'
headers = {'Authorization': f'Bearer {access_token}'}
response = requests.get(api_endpoint, headers=headers)

if response.status_code == 200:
    data = response.json()

data contains the geojson that can be loaded as:
dl.GeoJSON(data=data)

Maybe adding an optional argument such as headers would be enough:
api_endpoint = settings.API_BASE_URL + f'/fields/{field_id}/geojson'
headers = {'Authorization': f'Bearer {access_token}'}
dl.GeoJSON(url=api_endpoint, headers=headers)

@jajberni do you have a (publicly accessable) url that I could use for testing a potential implementation?


Graph Node not respecting startBlock for new deployments

Observed on the Hosted Service

Reproduced on the hosted service and locally. Looking into it now.

Bisecting locally resulted in this:
640b6bbf00c2bda5ed82bacedb15b3798e3e0765 is the first bad commit
commit 640b6bbf00c2bda5ed82bacedb15b3798e3e0765
Author: David Lutterkort<EMAIL_ADDRESS>Date:   Mon Mar 14 12:13:39 2022 -0700

    all: Introduce a DeploymentCreate struct

    We were using SubgraphDeploymentEntity for both reading and creating
    deployments. But when creating a deployment, a lot of the fields of
    SubgraphDeploymentEntity must default to specific values (e.g., latest
    block must be null), and using SubgraphDeploymentEntity obscured what could
    be set and whatcouldn't be set.


Use 0.10.0-beta.2 for the upcoming release

We just bumped the version number to 0.10.0-beta2 but that format causes cargo to automatically pull the new version. We can use 0.10.1-beta.2 so cargo correctly treats it as a new separate version.

Published and yanked :( same issue.
I think I'll just try to use this version in Elements locally (I think cargo will let me use a yanked version, it'll just whine about it) and if that passes let's just do a real release.

Ok, cargo won't let me use the yanked version, but I can use my local repo.

Ok, I have two comments so far:

The signature is wrong on data_part_ascii_no_checksum. It returns a &[u8] (which defaults to the lifetime on &self) but needs to return &'s [u8]. Probably same with the other accessors. Without this fix I get borrowck errors all over the place.
I would actually like a Fe32 iterator on CheckedHrpString; this is the intermediate iterator used in constructing the return value of byte_iter so it'll be easy to implement.

Also it would make my life a tiny bit easier if validate_padding and validate_witness_program_length were pub ... but I don't think we want to do that, it'd make the API too messy and expose too many internals.

I"ll work o the points above. As far as naming, shall we just use -gamma like you said before. This is slightly amusing that with our combined number of years writing rust we are having so much difficulty naming a new 'beta' version'.

I'm doubtful that gamma will work when beta2 didn't, but we might as well try it!

Want to just test the new stuff locally on your end (i.e., after that new stuff above) and the just release the v0.10.0?

Yeah, I think that's best. Next time we'll try starting with beta.0 etc and see if that works.

Ok, I have two comments so far:

The signature is wrong on data_part_ascii_no_checksum. It returns a &[u8] (which defaults to the lifetime on &self) but needs to return &'s [u8]. Probably same with the other accessors. Without this fix I get borrowck errors all over the place.
I would actually like a Fe32 iterator on CheckedHrpString; this is the intermediate iterator used in constructing the return value of byte_iter so it'll be easy to implement.

Also it would make my life a tiny bit easier if validate_padding and validate_witness_program_length were pub ... but I don't think we want to do that, it'd make the API too messy and expose too many internals.

All this should be seen to now.


Incorrect data with multiple filters

This ensures that the details and breakdown pages represent the correct cost when multiple filters are applied.

Updated query functions to use either logical AND or logical OR
Fixed sum calculation of costs in getComuptedReportItem
Renamed filterBy props as groupByValue
Added filter_by params to summary cards
Modified breakdown querys to include group_by from previous page as a filter

https://issues.redhat.com/browse/COST-1131
Details page with filters

Breakdown page

Codecov Report

Merging #1902 (28adafc) into master (a02904a) will increase coverage by 0.42%.
The diff coverage is 72.97%.

@@            Coverage Diff             @@
##           master    #1902      +/-   ##
==========================================
+ Coverage   70.68%   71.11%   +0.42%
==========================================
  Files         371      371
  Lines        6331     6934     +603
  Branches     1129     1487     +358
==========================================
+ Hits         4475     4931     +456
- Misses       1742     1979     +237
+ Partials      114       24      -90

Impacted Files
Coverage Δ

src/api/queries/query.ts
44.77% <41.17%> (+0.51%)
:arrow_up:

src/utils/computedReport/getComputedReportItems.ts
78.16% <100.00%> (+21.19%)
:arrow_up:

...c/pages/costModels/createCostModelWizard/table.tsx
34.28% <0.00%> (-10.16%)
:arrow_down:

src/components/i18n/i18nProvider.tsx
57.14% <0.00%> (-9.53%)
:arrow_down:

src/pages/state/maintenance/maintenanceState.tsx
66.66% <0.00%> (-8.34%)
:arrow_down:

.../pages/costModels/createCostModelWizard/markup.tsx
27.27% <0.00%> (-8.03%)
:arrow_down:

...ges/costModels/costModelsDetails/utils/toolbar.tsx
77.50% <0.00%> (-7.80%)
:arrow_down:

...ostModels/createCostModelWizard/priceListTable.tsx
32.07% <0.00%> (-7.46%)
:arrow_down:

.../costModels/costModelsDetails/bottomPagination.tsx
82.60% <0.00%> (-7.40%)
:arrow_down:

src/store/common.ts
81.81% <0.00%> (-7.08%)
:arrow_down:

... and 125 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a02904a...a787bae. Read the comment docs.


Feature/gradle

@fake-deli-ca Please sign the Contributor License Agreement!
Click here to manually synchronize the status of this Pull Request.
See the FAQ for frequently asked questions.


Bolus wizard record parsing and upload

Further work needs to be done (preferably by someone who actually uses the MDT Bolus Wizard) to figure out where OpenAPS' parsing of of bolus wizard records is not behaving as intended, why, and how we might fix it (without breaking anything else).
Recent problem reports include https://gitter.im/nightscout/intend-to-bolus?at=59de4834614889d475a0c357 from @bdr1177, who only saw the carb portion and not the bolus portion of 0.6U that was delivered via the bolus wizard for 26 carbs.
Also, Petra and Erik Bängtsson provided a very detailed report, which I will post as a comment to this issue.
I think the next step is for someone to get a test rig and test pump set up, posting to a test NS instance, and try to reliably reproduce these issues, so they can begin digging into the actual pumphistory.json contents, compare that to the parsing and uploading code, and figure out where the gaps are.  We'll likely identify two different classes of issues: one (hopefully rare) class involves parsing of pumphistory, where for example bolus wizard records with only carbs and no bolus are incorrectly used by OpenAPS, or (possibly) that complete bolus wizard records are completely ignored.  The second (more common) class of issues is with NS uploads, where records that are properly recognized and used by OpenAPS do not show up in NS.

From Petra and Erik Bängtsson:
If carbs are entered via the bolus wizard, but the user does not press ACT the last time to actually deliver the bolus, the carbs are nevertheless exported to Nightscout and included by OpenAPS in its calculation (it shows up in the OpenAPS-pill as COB as well as in papertrail).
I have attached a zip with logs and here are the times to look for: GhostCarbEntries.zip All time entries are Central European Time  (UTC+1).
2017 Oct 10th 10:41. 40 carbs logged through bolus wizard on pump. No insulin delivered because ACT was not pressed the final time. Logged in Nightscout as carb correction and shown up as COB in the OpenAPS-pill.
2017 Oct 10th 17:28. 23 carbs logged through bolus wizard on pump. No insulin delivered because ACT was not pressed a final time. Logged in Nightscout as carb correction and shown up as COB in the OpenAPS-pill.
2017 Oct 10 17.34. 23 carbs and 0.65 u of insulin deliverd by pump through the bolus wizard. Both insulin and carb logged in Nightscout and used by OpenAPS.
The lunch bolus (at 10.41) was an accident - our 7yo normally does this without problem, enter carbs and delivers bolus via the bolus wizard, but this time he failed.
The dinner bolus (at ~17:30) was me stressing the system.
This was done with pull #694 of dev 0.6.0. A Minimed Paradigm 554 (MMT-554WWB) with software version 2.6A.
I have a couple of questions:

Is this expected behaviour? That the carbs should show up in Nightscout and in the COB-part of the OpenAPS-pill. I read somewhere that carbs given through the bolus wizard are not accounted for if not given with a bolus.

Does the fact that the carbs show up as COB in the OpenAPS-pill (and in papertrail logs) mean that these carbs are taken into account in the OpenAPS algorithm and affect the amount of temp basal given? In the case of the lunch bolus it probably saved our day because the system compensated. But it could of course mean that the system also delivers to much insulin.

A minor, but maybe related issue, is when a bolus/carbs pair from the bolus wizard only show the carb part in Nightscout. The insulin part does show up in the IOB-pill (as basal IOB, not Care portal IOB). If you are interested in these you will find them in the attached log at these time points:
2017 Oct 9th 10:41. 40 carbs logged. 1.15 u given by pump but not logged in Nightscout.
2017 Oct 9th 14:07, 30 carbs logged, 0.85 u given by pump but not logged in Nightscout.
Please tell me if there is something more we should test or give you any more data. Now that we are more used to OpenAPS we can more easly test stuff.
Thank you for everything you do. Nowadays we go to bed in the evening without a lump in our stomachs because OpenAPS are watching over our son.

We have also seen this issue intermittently and have not identified any specific pattern/sequence of events that seem associated.   I believe we have seen carbs only entries w/o associated insulin bolus.  I wonder if it is important for individuals seeing this behaviour to share their pump model as part of investigation.  We have a spare MDT pump, but not the same model as we are using - theoretically could set up a test rig, but not before the weekend at earliest.

I tried to conclusively fix this back in the day and have related code (in JavaScript, a replacement for the bash-based tool). Can we commit as much test data to the repo as possible? This is a good place for unit tests / TDD.

How do you want people to "commit as much test data to the repo as possible"?

I was thinking of actual json dumps of the pump records, which reproduce the current unwanted behavior, and then implementing tests that load this data.

Stuff I toyed with before is in https://github.com/sulkaharo/oref0-tools/blob/master/bin/oref0-mm-format-ns-treatments.js - the logic there can be simplified a lot

So would you rather have people post the json to this issue, as I did with Bängtsson's .zip file, or something else?

Posting the json here works!
The problematic use case we've encountered before is the Bolus Wizard logic where the pump times out from the UI after 30 seconds (and with accidental ESC presses) and this happening a lot in the daycare, which resulted in up to three erroneous carb entries to pile up in addition to the real entry with a bolus, causing the loop to high temp considerably.
AFAIK the earlier carb entries being sent to NS without bolus were all a case of the rig having pulled the records between the bolus wizard having been used for data entry and the bolus being completed. The logic for the data storage seems to be as follows:

If user enters any data to bolus wizard (non-zero carbs / BG value), a bolus wizard record is created with this data, regardless of what happens next. This entry is created whatever the reason for exiting the menu is (time out / ESC presses / confirming the bolus).

If user confirms the suggested bolus, a second bolus record is created, with meta-data from the previous entry. This entry is first created with 0 IU of bolus delivered and is updated each time the pump motor moves to deliver more insulin, to ensure the insulin record is exact in case of a power outage during the bolus delivery (so if you pull the battery during the bolus being delivered, IOB can still be calculated correctly).

AFAIK we can skip the first entry type in all cases and just parse the second entry type. To guarantee correct data, pulling pump records should be avoided during bolusing, as the bolus amount will be different from when the bolus has finished delivery, unless the record is subsequently updated correctly.

I don't think we can eliminate the race condition of a bolus starting between the time we do a bolusing check and when we pull pumphistory.  So I think we instead need to figure out a mechanism for updating such records if we pull them and see they've changed.  Since OpenAPS doesn't keep any state, and just re-pulls the records from the pump each time, that probably means changing the way we do NS uploads to check not only whether a bolus wizard record already exists with the same (or later) timestamp, but actually checking the contents (or doing an upsert, or whatever) to make sure it gets uploaded in NS after having been uploaded without a bolus amount...

If you are explicit about what data you want we can post.  I'm assuming data that includes the targeted error will be important and may be more limiting due to the intermittent nature.  I don't think we've seen it in a few weeks, but could possibly go back and find them in historical data.

@JELCRAWFORD The trick is - it's hard to say what data we need to reproduce the issue if we don't know exactly what the issue is. :) So if we got a couple pumphistory.json files that cover the time span where this issue appeared, it might help find out if this is a data issue or something else (or a mix of issues).
@scottleibrand NS already does upserts, so as long as the timestamp of the event doesn't change, the database should support data updates already.

Yeah, but I don't think OpenAPS uses the upserts right now.  I think we instead do a check of the most recent treatment, and only try to upload treatments newer than that.

@sulkaharo  - about the trickiness - Agreed (though your ideas seem pretty good to me already, I must say!).  As indicated, we can certainly post if we see the problem and I can skim through history and see if we can find some examples and then try to pull the appropriate pumphistory.json.  A few weeks ago we had a couple of times in a 2 day span.  I'm nearly positive we’ve NOT seen this since 0.6.0 though…  but it sounds that others have.

Hi everybody, Petra Bängtsson here. Nice to hear that there might be a solution to this problem.
Just one word about reproducibility: The issue where a bolus wizard entry is not completed correctly and a "ghost" carb entry is used by OpenAPS is easily reproduced. The issue where the insulin part of a bolus wizard entry is delivered by do not show up in Nightscout is not reproducible and rather intermittent, might be hard to catch.
Unfortunately we do not have a spare pump/rig but if this problems appear again I will add the pumphistory.json file to this feed.

At suggestion of Scott Leibrand, I am posting some information relating to missing manual bolus correction treatment in NS.  Scott was able to quickly ascertain that despite the absence of the treatment in NS altogether (both in treatment section as well as within the normal viewing area for that period), that the IOB both before and after this manual bolus were found to be correct and therefore loop was functioning properly--just not displaying the results correctly within NS.

The issue with missing insulin entry in Nightscout happened again. Today, 14 October at 12.57, 40 carbs were entered into the bolus wizard and a bolus of 1.3 u was given by the pump. The carbs, but not the insulin, show up in Nightscout. IOB pill is updated as if the insulin is present. The carbs are logged as carb correction in Nightscout. Time is in Central European Time (UTC +01), pump 554. Nightscout on Heroku. Logs here:
MissingInsulinEntry.zip
One thought on logs: I'm always uncertain what logs to include for an issue like this. I also know that the logs wrap and if you are not quick enough the interesting parts would disappear. Would it be possible to make a script that collects the interesting files into a folder or a zip on the rig. Preferably this script should be able to trigger from Nightscout so you could start it from your phone if you are not able to connect to the rig at the moment. You could then access the saved files later. Just an idea...

We've now had 4 carb entry only incidents in the last 48hrs (so much for my low pump battery theory!).
Is this where we are collecting .json data?

@sulka can correct if I'm wrong, but I think we now understand the "only carbs uploaded to NS" issue well enough we don't need any more logs or json files for that.
It might still be useful to get info to help us reproduce any instances of canceled bolus wizard entries showing up in COB though.

If you have a pump model other than 554, please upload a sample of your pumphistory.json. One sample / pump model is enough. Please also post what exact pump model you got (model number, firmware version, ww/eu) and if you enter the BG when using the wizard.

Scott yes that’s highly likely, but I’d love to see if the event format really is consistent across models.

I have been plagued with this and asked about it on gitter a few weeks ago. The offered solution was to update my NS version to latest dev, I also went to latest oref 0.6.0dev at that time but it didn't fix it for me. Using a 715WW with 2.3A, normal boluses show up, but not when using the bolus wiz. Carbs and insulin are taken into account by openaps, they just don't appear as a dot in NS. Will try a different pump and see if it's model dependent. I have my pumphistory.json ready if you need it.

Ok, just tested with same rig and different pump, 722WW with 2.4A, manual "normal" boluses appear in NS, but when administered using the bolus wizard, that fail to show up.
They appear in the "treatments" page of the reports, and are taken into account by openaps, the white/blue dot is just missing.

... and same rig, but with a 754WW with 2.6A, bolus wizard treatments appear normally.

Might be good to capture the pumphistory records from two different model pumps for the same thing. If they're identical, that points to a race condition on the upload. If not, we might need to make the parsing model-aware.

Here you go, I captured the pumphistory.json bits about bolus wizard events using the 3 different pumps and the same rig. It seems that with the 715 and 722, dots or commas are missing from the BG values and target values. (I use mmol/L in Finland). With the 754, the BG values are formatted correctly, see below:
#754
{
"_type": "BolusWizard",
"bg": 6.0,
"bg_target_high": 6.0,
"_description": "BolusWizard 2017-11-01T16:40:33 head[2], body[15] op[0x5b]",
"timestamp": "2017-11-01T16:40:33",
"_body": "0f900096463700002800000e00283c",
"_head": "5b3c",
"unabsorbed_insulin_total": 0.35,
"correction_estimate": 0.0,
"_date": "a1e8100111",
"bolus_estimate": 1.0,
"bg_target_low": 5.5,
"carb_ratio": 15.0,
"food_estimate": 1.0,
"carb_input": 15,
"sensitivity": 7.0
},
#715 with BG target 4.0 - 5.0, sensitivity 3 mmol/l/U, carb ratio 1U:20g
{
"_type": "BolusWizard",
"bg": 44,
"bg_target_high": 50,
"correction_estimate": 0.0,
"unknown_byte[10]": 0,
"_description": "BolusWizard 2017-10-31T11:47:29 head[2], body[13] op[0x5b]",
"timestamp": "2017-10-31T11:47:29",
"_body": "1490141e28000a000010000a32",
"carb_input": 20,
"_head": "5b2c",
"unabsorbed_insulin_total": 1.6,
"_byte[5]": 0,
"unabsorbed_insulin_count": "??",
"_byte[7]": 0,
"_date": "9daf0b1f11",
"bolus_estimate": 1.0,
"unknown_byte[8]": 0,
"carb_ratio": 20,
"food_estimate": 1.0,
"bg_target_low": 40,
"sensitivity": 30
},
#722 with BG target 5.6 - 5.6, sensitivity 2.2 mmol/l/U, carb ratio 1U:10g
{
"_type": "BolusWizard",
"bg": 71,
"bg_target_high": 56,
"correction_estimate": 0.6,
"unknown_byte[10]": 0,
"_description": "BolusWizard 2017-11-01T13:29:10 head[2], body[13] op[0x5b]",
"timestamp": "2017-11-01T13:29:10",
"_body": "32900a1638063200000a003238",
"carb_input": 50,
"_head": "5b47",
"unabsorbed_insulin_total": 1.0,
"_byte[5]": 6,
"unabsorbed_insulin_count": "??",
"_byte[7]": 0,
"_date": "8add0d0111",
"bolus_estimate": 5.0,
"unknown_byte[8]": 0,
"carb_ratio": 10,
"food_estimate": 5.0,
"bg_target_low": 56,
"sensitivity": 22
},

Ok here is more of that. Taken with the 722 pump.
I started a few bolus wizard events but exited with ESC before bolusing (eg at 15:42 and 15:49).
Then I did a normal bolus wizard event at 16:00:57, declaring BG 6.6 mmol/l, carbs 44g and the calculated bolus wa 4.8U:
{
"_type": "TempBasalDuration",
"duration (min)": 30,
"_description": "TempBasalDuration 2017-11-04T16:05:04 head[2], body[0] op[0x16]",
"timestamp": "2017-11-04T16:05:04",
"_body": "",
"_head": "1601",
"_date": "84c5104411"
},
{
"_type": "TempBasal",
"temp": "absolute",
"_description": "TempBasal 2017-11-04T16:05:04 head[2], body[1] op[0x33]",
"timestamp": "2017-11-04T16:05:04",
"_body": "00",
"_head": "3300",
"rate": 0.0,
"_date": "84c5104411"
},
{
"programmed": 4.8,
"_type": "Bolus",
"type": "normal",
"_description": "Bolus 2017-11-04T16:00:57 head[4], body[0] op[0x01]",
"duration": 0,
"timestamp": "2017-11-04T16:00:57",
"_body": "",
"_head": "01303000",
"amount": 4.8,
"_date": "b9c0300411"
},
{
"_type": "BolusWizard",
"bg": 66,
"bg_target_high": 56,
"correction_estimate": 0.4,
"unknown_byte[10]": 0,
"_description": "BolusWizard 2017-11-04T16:00:57 head[2], body[13] op[0x5b]",
"timestamp": "2017-11-04T16:00:57",
"_body": "2c900a1638042c000000003038",
"carb_input": 44,
"_head": "5b42",
"unabsorbed_insulin_total": 0.0,
"_byte[5]": 4,
"unabsorbed_insulin_count": "??",
"_byte[7]": 0,
"_date": "b9c0100411",
"bolus_estimate": 4.8,
"unknown_byte[8]": 0,
"carb_ratio": 10,
"food_estimate": 4.4,
"bg_target_low": 56,
"sensitivity": 22
},
{
"_type": "CalBGForPH",
"_description": "CalBGForPH 2017-11-04T16:00:45 head[2], body[0] op[0x0a]",
"timestamp": "2017-11-04T16:00:45",
"_body": "",
"_head": "0a42",
"amount": 66,
"_date": "adc0500411"
},
{
"_type": "CalBGForPH",
"_description": "CalBGForPH 2017-11-04T15:55:51 head[2], body[0] op[0x0a]",
"timestamp": "2017-11-04T15:55:51",
"_body": "",
"_head": "0a35",
"amount": 53,
"_date": "b3f74f0411"
},
{
"_type": "TempBasalDuration",
"duration (min)": 30,
"_description": "TempBasalDuration 2017-11-04T15:54:42 head[2], body[0] op[0x16]",
"timestamp": "2017-11-04T15:54:42",
"_body": "",
"_head": "1601",
"_date": "aaf60f4411"
},
{
"_type": "TempBasal",
"temp": "absolute",
"_description": "TempBasal 2017-11-04T15:54:42 head[2], body[1] op[0x33]",
"timestamp": "2017-11-04T15:54:42",
"_body": "00",
"_head": "333e",
"rate": 1.55,
"_date": "aaf60f4411"
},
{
"_type": "TempBasalDuration",
"duration (min)": 30,
"_description": "TempBasalDuration 2017-11-04T15:51:08 head[2], body[0] op[0x16]",
"timestamp": "2017-11-04T15:51:08",
"_body": "",
"_head": "1601",
"_date": "88f30f4411"
},
{
"_type": "TempBasal",
"temp": "absolute",
"_description": "TempBasal 2017-11-04T15:51:08 head[2], body[1] op[0x33]",
"timestamp": "2017-11-04T15:51:08",
"_body": "00",
"_head": "3332",
"rate": 1.25,
"_date": "88f30f4411"
},
{
"_type": "CalBGForPH",
"_description": "CalBGForPH 2017-11-04T15:49:23 head[2], body[0] op[0x0a]",
"timestamp": "2017-11-04T15:49:23",
"_body": "",
"_head": "0a3e",
"amount": 62,
"_date": "97f14f0411"
},
{
"_type": "CalBGForPH",
"_description": "CalBGForPH 2017-11-04T15:42:05 head[2], body[0] op[0x0a]",
"timestamp": "2017-11-04T15:42:05",
"_body": "",
"_head": "0a3c",
"amount": 60,
"_date": "85ea4f0411"
},
{
"_type": "TempBasalDuration",
"duration (min)": 120,
"_description": "TempBasalDuration 2017-11-04T15:33:18 head[2], body[0] op[0x16]",
"timestamp": "2017-11-04T15:33:18",
"_body": "",
"_head": "1604",
"_date": "92e10f4411"
},
{
"_type": "TempBasal",
"temp": "absolute",
"_description": "TempBasal 2017-11-04T15:33:18 head[2], body[1] op[0x33]",
"timestamp": "2017-11-04T15:33:18",
"_body": "00",
"_head": "3300",
"rate": 0.0,
"_date": "92e10f4411"
},
{
"_type": "Prime",
"type": "manual",
"_description": "Prime 2017-11-04T15:23:15 head[5], body[0] op[0x03]",
"timestamp": "2017-11-04T15:23:15",
"_body": "",
"fixed": 0.0,
"_head": "030000000f",
"amount": 1.5,
"_date": "8fd72f0411"
},
{
"_type": "Rewind",
"_description": "Rewind 2017-11-04T15:23:05 head[2], body[0] op[0x21]",
"timestamp": "2017-11-04T15:23:05",
"_body": "",
"_head": "2100",
"_date": "85d70f0411"
}
]

I just found and fixed one cause of incorrect "skipping bolus wizard entry with carbs and no insulin" messages: the bolus wizard and corresponding bolus record can be logged with timestamps that differ by 1 second.  The fix in commit 2eee14b6e44493e9f0442f6b33e980480290a325 (in https://github.com/openaps/oref0/pull/772 for now) is to look for records up to 1s apart.

I think we have to focus on the decocare issue of having the BG values increased by a factor 10.
I issued a BW event with a 715WW pump and as expected, it didn't show up in NS. I went to the treatments page of the NS reports and the event was there, but the BG was "69" and not 6.9mmol/l. I just edited the BG value and ta-daa, the blue/white dot appeared correctly in NS.
The carbs and bolus were taken into account normally by openaps,
So it's just a matter of decocare importing the pumphistory in a valid way.

We have seen issues with the mmol conversion for a long time, though I’ve not been able to identify a consistent pattern that produces it - we see as you do @lsandini - in treatments a bg will come in as 60 when it should be read as 6.0. As far as I can tell, this seems to produce a visualization problem primarily. Last week it compressed our graph for 24 hrs. Ironically, the compressed graph with flatter line by virtue of the compression effect of such a high bg in mmol’s results in less frustration to me :). We did not see negative consequences in the loop which would be more problematic.

Found a partial solution to the COB=0 issue (other than the 1 second difference Scott fixed). See
https://github.com/openaps/oref0/issues/777 for discussion and PR 780 for a suggested (partial) fix. Please help test that fix.

Closing this as we’ve replaced all the pumphistory parsing code in 0.7.0. If you see any more problems there please open a new issue.


Feature: dev-ex - just help

Suggested solution
There are a few things we could do with just to make it abit easier to use:

include a just help command to make the onboarding experience abit easier
document each command

This should be all we need to do along with just documenting commands that aren't already documented.
help:
  @echo "Available commands:"
  @just --list


document.toJSON() includes invalid document items

Not sure if this should throw an error or just remove any documentItems that don't pass validation.

Add options hash to toJSON() e.g. excludeInvalid: true


apt-get update 404 on http://httpredir.debian.org/debian/dists/jessie/main/binary-amd64/Packages

It seems that running apt-get update fails with 404 Not Found. The referenced Packages file can be downloaded as Packages.gz and Packages.xz on the host, but not as plain Packages.
Expected behavior: the newest version of the package index is downloaded
Actual behavior: 404 not found.
To reproduce:
$ docker run debian:jessie cat /etc/apt/sources.list
deb http://httpredir.debian.org/debian jessie main
deb http://httpredir.debian.org/debian jessie-updates main
deb http://security.debian.org jessie/updates main

$ docker run debian:jessie apt-get update
Ign http://security.debian.org jessie/updates InRelease
Ign http://httpredir.debian.org jessie InRelease
Ign http://security.debian.org jessie/updates Release.gpg
Ign http://security.debian.org jessie/updates Release
Ign http://httpredir.debian.org jessie-updates InRelease
Err http://security.debian.org jessie/updates/main amd64 Packages

Err http://security.debian.org jessie/updates/main amd64 Packages

Err http://security.debian.org jessie/updates/main amd64 Packages

Err http://security.debian.org jessie/updates/main amd64 Packages

Err http://security.debian.org jessie/updates/main amd64 Packages
  404  Not Found [IP: <IP_ADDRESS> 80]
Ign http://httpredir.debian.org jessie Release.gpg
Ign http://httpredir.debian.org jessie-updates Release.gpg
Ign http://httpredir.debian.org jessie Release
Ign http://httpredir.debian.org jessie-updates Release
Err http://httpredir.debian.org jessie/main amd64 Packages
  404  Not Found [IP: <IP_ADDRESS> 80]
Err http://httpredir.debian.org jessie-updates/main amd64 Packages
  404  Not Found [IP: <IP_ADDRESS> 80]
W: Failed to fetch http://security.debian.org/dists/jessie/updates/main/binary-amd64/Packages  404  Not Found [IP: <IP_ADDRESS> 80]

W: Failed to fetch http://httpredir.debian.org/debian/dists/jessie/main/binary-amd64/Packages  404  Not Found [IP: <IP_ADDRESS> 80]

W: Failed to fetch http://httpredir.debian.org/debian/dists/jessie-updates/main/binary-amd64/Packages  404  Not Found [IP: <IP_ADDRESS> 80]

E: Some index files failed to download. They have been ignored, or old ones used instead.

$ docker --version
Docker version 1.8.3, build f4bf5c7-dirty

It seems that there must've been a server down; it is working here.

Weird, I get
'''
$ curl http://security.debian.org/dists/jessie/updates/main/binary-amd64/Packages

404 Not Found

Not Found
The requested URL /dists/jessie/updates/main/binary-amd64/Packages was not found on this server.

Apache Server at security.debian.org Port 80

'''
Any ideas?

I get the same 404 if I curl that url, but apt-get update works just fine.  apt-get actually requests the gzipped version. I tried this: curl --head http://security.debian.org/dists/jessie/updates/main/binary-amd64/Packages.gz

Yeah, seems to work just fine here:
$ docker run -it --rm debian:jessie apt-get update
Get:1 http://security.debian.org jessie/updates InRelease [63.1 kB]
Ign http://httpredir.debian.org jessie InRelease
Get:2 http://security.debian.org jessie/updates/main amd64 Packages [182 kB]
Get:3 http://httpredir.debian.org jessie-updates InRelease [135 kB]
Get:4 http://httpredir.debian.org jessie Release.gpg [2373 B]
Get:5 http://httpredir.debian.org jessie-updates/main amd64 Packages [3653 B]
Get:6 http://httpredir.debian.org jessie Release [148 kB]
Get:7 http://httpredir.debian.org jessie/main amd64 Packages [9035 kB]
Fetched 9569 kB in 4s (2041 kB/s)
Reading package lists... Done

Sounds like it's definitely a funky mirror hiccup.

Must be something with my network setup then. Thank you all for trying.

@bneijt - Maybe you fixed it, but I suspect your problem may have been like mine: I set up the proxy to whitelist debian.org, but the gzipped package list redirects with 302 to another mirror next to me.  Use curl --head from your host to discover which one or curl -L to see if your host can get to it...
HTH! :)

I had another go and found my problem: it was a firewall setting. The hint that helped me was: HTTP did not work, FTP did work.
The machine running the docker images also had a PREROUTING redirect rule for hosting on port 80 from an unprivileged program:
 Chain PREROUTING (policy ACCEPT)
 num  target     prot opt source               destination
 1    REDIRECT   tcp  --  anywhere             anywhere             tcp dpt:http redir ports 5000
 2    DOCKER     all  --  anywhere             anywhere             ADDRTYPE match dst-type LOCAL

This was causing HTTP to fail, but checks like ping to succeed. There was also a nice 404 because the local service on port 5000 was responding 404.
Sorry for wasting time here!

Actually it seems to still happen for me, without any firewall / web proxy:
docker run -it --rm debian:jessie apt-get update
Ign http://httpredir.debian.org jessie InRelease
Get:1 http://security.debian.org jessie/updates InRelease [63.1 kB]
Ign http://httpredir.debian.org jessie-updates InRelease
Ign http://httpredir.debian.org jessie Release.gpg
Ign http://httpredir.debian.org jessie-updates Release.gpg
Ign http://httpredir.debian.org jessie Release
Ign http://httpredir.debian.org jessie-updates Release
Get:2 http://security.debian.org jessie/updates/main amd64 Packages [383 kB]
Err http://httpredir.debian.org jessie/main amd64 Packages
  404  Not Found [IP: <IP_ADDRESS> 80]
Err http://httpredir.debian.org jessie-updates/main amd64 Packages
  404  Not Found [IP: <IP_ADDRESS> 80]
Fetched 447 kB in 1s (356 kB/s)
W: Failed to fetch http://httpredir.debian.org/debian/dists/jessie/main/binary-amd64/Packages  404  Not Found [IP: <IP_ADDRESS> 80]

W: Failed to fetch http://httpredir.debian.org/debian/dists/jessie-updates/main/binary-amd64/Packages  404  Not Found [IP: <IP_ADDRESS> 80]

E: Some index files failed to download. They have been ignored, or old ones used instead.

@marek-obuchowicz
I am facing exact same issue
did you find any solution?

For me it was docker-machine issue. It did not refresh DNS servers when I moved to another network. Restart of docker-machine has helped.

i'm seeing this as well. When I go to the link, I'm getting not found, regardless of mirror.

Its a CDN issue I think,
GET http://deb.debian.org/debian/dists/jessie/InRelease HTTP/1.1
Host: deb.debian.org
responds with
HTTP/1.1 302 Found
Date: Sun, 20 Nov 2016 07:39:37 GMT
Server: Apache
Location: http://cdn-fastly.deb.debian.org/debian/dists/jessie/InRelease
Content-Length: 310
Content-Type: text/html; charset=iso-8859-1
So
GET http://cdn-fastly.deb.debian.org/debian/dists/jessie/InRelease HTTP/1.1
Host: cdn-fastly.deb.debian.org
HTTP/1.1 404 Not Found
Server: Apache
Content-Type: text/html; charset=iso-8859-1
Via: 1.1 varnish
Fastly-Debug-Digest: 9527c5c1499ebb0550ce27502e9d291aae30e5bb3c04a33757ef522c9f1fe819
Content-Length: 291
Accept-Ranges: bytes
Date: Sun, 20 Nov 2016 07:39:38 GMT
Via: 1.1 varnish
Age: 79
Connection: keep-alive
X-Served-By: cache-ams4141-AMS, cache-ord1737-ORD
X-Cache: HIT, HIT
X-Cache-Hits: 1, 2
X-Timer: S1479627578.037931,VS0,VE0

Happened again today :(
docker run -it --rm debian:jessie apt-get update
Err http://deb.debian.org jessie InRelease
Err http://security.debian.org jessie/updates InRelease
Err http://deb.debian.org jessie-updates InRelease
Err http://security.debian.org jessie/updates Release.gpg
Could not resolve 'security.debian.org'
Err http://deb.debian.org jessie Release.gpg
Could not resolve 'deb.debian.org'
Err http://deb.debian.org jessie-updates Release.gpg
Could not resolve 'deb.debian.org'
Reading package lists... Done
W: Failed to fetch http://deb.debian.org/debian/dists/jessie/InRelease
W: Failed to fetch http://deb.debian.org/debian/dists/jessie-updates/InRelease
W: Failed to fetch http://security.debian.org/dists/jessie/updates/InRelease
W: Failed to fetch http://deb.debian.org/debian/dists/jessie/Release.gpg  Could not resolve 'deb.debian.org'
W: Failed to fetch http://security.debian.org/dists/jessie/updates/Release.gpg  Could not resolve 'security.debian.org'
W: Failed to fetch http://deb.debian.org/debian/dists/jessie-updates/Release.gpg  Could not resolve 'deb.debian.org'
W: Some index files failed to download. They have been ignored, or old ones used instead.

Have very similar issue on BananaPi single board computer today.
root@bananapi ~ # apt-get update
Hit http://security.debian.org jessie/updates InRelease
Ign http://ftp.debian.org jessie InRelease
Hit http://dl.bananian.org 1604 InRelease
Hit http://ftp.debian.org jessie Release.gpg
Hit http://ftp.debian.org jessie Release
Hit http://security.debian.org jessie/updates/main armhf Packages
Hit http://security.debian.org jessie/updates/main Translation-en
Hit http://dl.bananian.org 1604/main armhf Packages
Get:1 http://ftp.debian.org jessie/main armhf Packages [6,632 kB]
Ign http://dl.bananian.org 1604/main Translation-en_US
Ign http://dl.bananian.org 1604/main Translation-en
Ign http://dl.bananian.org 1604/main Translation-de_DE
Hit http://ftp.debian.org jessie/main Translation-en
Hit http://ftp.debian.org jessie/main Translation-de_DE
Err http://ftp.debian.org jessie/main armhf Packages

Err http://ftp.debian.org jessie/main armhf Packages

Err http://ftp.debian.org jessie/main armhf Packages
  404  Not Found [IP: <IP_ADDRESS> 80]
Fetched 6,632 kB in 9s (695 kB/s)
W: Failed to fetch http://ftp.debian.org/debian/dists/jessie/main/binary-armhf/Packages  404  Not Found [IP: <IP_ADDRESS> 80]

E: Some index files failed to download. They have been ignored, or old ones used instead.
apt-get update  12.56s user 1.77s system 147% cpu 9.742 total

I had the same problem. Here is the solution that helped me: https://robinwinslow.uk/2016/06/23/fix-docker-networking-dns/

apt-get update is failing :(
Hit http://software.ligo.org jessie InRelease
Hit http://security.debian.org jessie/updates InRelease
Ign http://ftp.de.debian.org jessie InRelease
Ign http://ftp.us.debian.org jessie InRelease
Hit http://ftp.de.debian.org sid InRelease
Hit http://ftp.us.debian.org jessie Release.gpg
Hit http://security.debian.org jessie/updates/main Sources
Hit http://ftp.de.debian.org jessie Release.gpg
Hit http://ftp.us.debian.org jessie Release
Hit http://software.ligo.org jessie/contrib Sources
Hit http://security.debian.org jessie/updates/main amd64 Packages
Ign http://httpredir.debian.org jessie InRelease
Hit http://security.debian.org jessie/updates/main i386 Packages
Get:1 http://ftp.de.debian.org sid/main amd64 Packages/DiffIndex [27.9 kB]
Hit http://software.ligo.org jessie/contrib amd64 Packages
Get:2 http://ftp.us.debian.org jessie/main amd64 Packages [6,776 kB]
Hit http://httpredir.debian.org jessie-updates InRelease
Hit http://httpredir.debian.org jessie Release.gpg
Get:3 http://ftp.us.debian.org jessie/contrib amd64 Packages [50.2 kB]
Get:4 http://ftp.us.debian.org jessie/non-free amd64 Packages [83.6 kB]
Get:5 http://ftp.de.debian.org sid/main i386 Packages/DiffIndex [27.9 kB]
Get:6 http://ftp.us.debian.org jessie/main i386 Packages [6,779 kB]
Get:7 http://ftp.us.debian.org jessie/contrib i386 Packages [49.5 kB]
Hit http://ftp.de.debian.org jessie Release
Get:8 http://httpredir.debian.org jessie-updates/main Sources [15.4 kB]
Get:9 http://ftp.us.debian.org jessie/non-free i386 Packages [80.4 kB]
Get:10 http://httpredir.debian.org jessie-updates/main amd64 Packages/DiffIndex [6,916 B]
Get:11 http://httpredir.debian.org jessie-updates/main i386 Packages/DiffIndex [6,916 B]
Hit http://httpredir.debian.org jessie Release
Hit http://ftp.de.debian.org jessie/main amd64 Packages
Hit http://ftp.de.debian.org jessie/main i386 Packages
Get:12 http://httpredir.debian.org jessie/main amd64 Packages [6,776 kB]
Hit http://httpredir.debian.org jessie/main Sources
Get:13 http://httpredir.debian.org jessie/main i386 Packages [6,779 kB]
Fetched 69.7 kB in 9s (7,083 B/s)
W: Failed to fetch http://security.debian.org/dists/jessie/updates/InRelease  Unable to find expected entry 'main/binary-sid/Packages' in Release file (Wrong sources.list entry or malformed file)
W: Failed to fetch http://software.ligo.org/lscsoft/debian/dists/jessie/InRelease  Unable to find expected entry 'contrib/binary-i386/Packages' in Release file (Wrong sources.list entry or malformed file)
W: Failed to fetch http://ftp.de.debian.org/debian/dists/sid/InRelease  Unable to find expected entry 'main/binary-sid/Packages' in Release file (Wrong sources.list entry or malformed file)
W: Failed to fetch http://httpredir.debian.org/debian/dists/jessie-updates/InRelease  Unable to find expected entry 'main/binary-sid/Packages' in Release file (Wrong sources.list entry or malformed file)
W: Failed to fetch http://ftp.us.debian.org/debian/dists/jessie/Release  Unable to find expected entry 'main/binary-sid/Packages' in Release file (Wrong sources.list entry or malformed file)
W: Failed to fetch http://ftp.de.debian.org/debian/dists/jessie/Release  Unable to find expected entry 'main/binary-sid/Packages' in Release file (Wrong sources.list entry or malformed file)
W: Failed to fetch http://httpredir.debian.org/debian/dists/jessie/Release  Unable to find expected entry 'main/binary-sid/Packages' in Release file (Wrong sources.list entry or malformed file)
E: Some index files failed to download. They have been ignored, or old ones used instead

Please try commenting the below line in /etc/apt/source.list
deb [arch=amd64] https://download.docker.com/linux/debian xenial stable
apt-get update works for me after commenting that line.

If you are working behind a proxy you need to tell the docker the proxy settings.
Use this alias to create a docker-build command with proxy settings:
cat << EOF >> ~/.bashrc
export HTTP_PROXY=http://proxy.paranoid.corp:8080
export HTTPS_PROXY=http://proxy.paranoid.corp:8080
alias docker-build="sudo docker build --build-arg http_proxy=$HTTP_PROXY --build-arg https_proxy=$HTTPS_PROXY"
EOF
Then source the new bashrc:
. ~/.bashrc
Of course your proxy will be different.  Ask your IT support.

sudo service docker restart &&  docker build --no-cache=true .

Thanks @Pherserk. I just restarted docker-machine and it worked. Already thought it's something really tough.

I have the sane issue, but i don't have Docker...

I had this issue, but it was fixed when I rebuilt the image with --no-cache and --pull.

This is a python-acme issue :  cerbot (free CA SSL certs). I just faced it tonight on debian strecth .. so same impact on Ubuntu platforms .. does any body already place a ticket about that ?