chore: offline package not upload aws s3

The download.pingcap.org domestic and foreign DNS are currently pointing to the qiniu cloud, so in the future do not need to upload to aws s3 offline package.

/lgtm

/lgtm


no valid session found,must call init and login before logout

From @adirzoari on October 22, 2016 17:26
I only have login via facebook in my ionic 2 app. I installed cordova plugins for that. Sometimes I see this message pop up on my app:

no valid session found,must call init and login before logout
and my app crashes. Below is a screenshot:

I have already tried to delete the app and install it again but the issue still persists.
Copied from original issue: driftyco/ionic-cli#1579

@jthoms1 thank you.
anyone has solution for that?
I'm still stuck with that.

This issue was moved to driftyco/ionic-native#756

Hello @adirzoari sorry for the moving around of this issue, but this is actually an ionic native issue so I have moved it to that repo. Thanks!


Bug : thumb  image url issue

i have noticed thumb urls has an extra redundant  \thumbs in its src url :
also thumb's image id seems odd , it has an /thumbs/ substring , that i think it should be modified too.
     <img id="E:\xampp\htdocs\pnu/public/photos/1/\thumbs//56d2c43764003.jpg"
         onclick="useFile('56d2c43764003.jpg')" style="cursor:pointer;" alt=""
          src="/photos/1/\thumbs/thumbs/56d2c43764003.jpg">

@amin101 Thanks for suggestion.
Related to #18

@amin101 Would you please check if version 1.4.0-alpha has this issue fixed?

I upgraded to 1.4.0-alpha and then everything failed.  i couldn't upload image (upload File button didnt work)or even see user /shared folder in the left sidebar(it was empty space).so i downgraded to 1.2 twice

@amin101 Could you paste here the console error messages and config/lfm.php in 1.4.0-alpha?

Merged pull request #43 .

#18


Create an SAP Cloud Application Programming Model Project for SAP HANA Cloud

Tutorials: https://developers.sap.com/tutorials/hana-cloud-cap-create-project.html
The tutorial seems to be outdated. We already encountered people in our unit having multiple deployment issues due to that.
Step 5 suggest to adjust the CAP project configuration by removing the "gen/db" path config for the deployer module and adding "db" instead. It also suggest to add a build configuration in the cds section of the package.json.
Both changes are outdated imo. The CAP sample repositories as well as production apps that are using CAP use "gen/db" as a path and configure the deploy format for the HANA artifacts in the package json by adding on the root of the cds config.
  "hana": {
      "deploy-format": "hdbtable"
    }

This seems to be the latest best practice :)

gen/db is the default configuration for CAP projects. However when using HANA Native tooling like the Calculation View editor, it is necessary to adjust this path. This was the workaround provided by the development team in order for the CAP project to be fully compatible with the HANA native tooling.


Add comments in the code and fix linting issue

FEATURE REQUEST?

What happened:

Add Comments in the code and fix linting issue

https://github.com/openebs/test-tools/blob/master/custom-client/liveness.py

I'll work on this

Do you have any list of the issues you are facing

Completed: https://github.com/openebs/test-tools/pull/59


[WIP] Fix the progress bar for the sanity check

The original progress bar will always show trainer.num_sanity_val_steps as val_progress_bar.total even if the length of the validation DataLoader is less than trainer.num_sanity_val_steps.
The pytorch_lightning.trainer.data_loading._has_len is changed to a public function has_len, which is called by pytorch_lightning.callbacks.progress.ProgressBar.
Import pytorch_lightning.trainer.data_loading from pytorch_lightning.callbacks.progress will lead to circular imports.
Maybe we could move pytorch_lightning.trainer.data_loading._has_len to other place.
Or we could save the sizes of validation (and train) DataLoaders as members of Trainer, which may be accessed by pytorch_lightning.callbacks.progress.ProgressBar.
What does this PR do?
Fixes #2891
Before submitting

[x] Was this discussed/approved via a Github issue? (no need for typos and docs improvements)
[x] Did you read the contributor guideline, Pull Request section?
[ ] Did you make sure your PR does only one thing, instead of bundling different changes together? Otherwise, we ask you to create a separate PR for every change.
[ ] Did you make sure to update the documentation with your changes?
[x] Did you write any new necessary tests?
[x] Did you verify new and existing tests pass locally with your changes?
[x] If you made a notable change (that affects users), did you update the CHANGELOG?

Hello @manipopopo! Thanks for opening this PR.

In the file tests/callbacks/test_progress_bar.py:

Line 220:63: W504 line break after binary operator

Do see the Hitchhiker's guide to code style

@manipopopo closing this then
@rohitgr7 just make sure if #2891 is really fixed.


ListedTaxon has empty list fields when created from Taxon.listed_taxa member

The problem
When I create a Taxon and try to use a specific Taxon.listed_taxa member, the list.title and list.id are not set.
Expected behavior
I expected the list.title and list.id attributes to be set to the corresponding fields that are present in the raw JSON /v1/taxa/{id} response.
Steps to reproduce the behavior
from pyinaturalist import get_taxa_by_id
from pyinaturalist.models import Taxon
ns = 6853
tufted_vetch = 52471
taxa = get_taxa_by_id(tufted_vetch, preferred_place_id=ns)
taxon = Taxon.from_json(taxa["results"][0])
listed_taxon = next((listed_taxon for listed_taxon in taxon.listed_taxa if listed_taxon.place.id == ns), None)
print(repr(listed_taxon.list))

results in:
{'id': None, 'title': None}

Workarounds
Use the raw JSON listed_taxon member instead:
from pyinaturalist import get_taxa_by_id
ns = 6853
tufted_vetch = 52471
taxa = get_taxa_by_id(tufted_vetch, preferred_place_id=ns)
listed_taxon = next((listed_taxon for listed_taxon in taxa["results"][0]["listed_taxa"] if listed_taxon["place"]["id"] == ns), None)
print(repr(listed_taxon["list"]))

results in:
{'id': 7186, 'title': 'Nova Scotia Check List'}

Environment

OS & version: Debian 10
Python version: 3.9
Pyinaturalist version: main branch

Thanks for the bug report, I'll get that fixed!


Use case redeploy an app and update the deployment plan

Here is what I want to achieve (in online mode):

Deploy a shared library (yes can be done already)
Redeploy a ear file and add a reference to the shared library (plan may exists already or not)

I am not sure how I can achieve 2:
I could of course extend the model and run a separate wlst script to change or create the plan, but then I have to connect twice.
Would it be possible to get a hook to run some wlst commands before deployment ?
Any other suggestions or thoughts ?
Best regards,
-Kai

you can extend the model using filters. The filters are not documented, but they are specifically used to extend the model before the deploy. However, the WLST connection has not yet been made,  which means you must open and close a connection (so 2 connections). If you are interested, I will write up notes about using filters. FYI, The redeploy strategy sounds like something we should explore.


Switch versioning to use this plugin

https://www.mojohaus.org/build-helper-maven-plugin/index.html

Switched to using GitHub Action run ids instead.


Strengthen testing of correctness of CST-AST desugarings

Category
New DRT target
Describe the feature you'd like to request
We should consider somehow strengthening our testing that the desugarings performed during CST-AST conversion have the semantic properties we want.  The goal would be to prevent another issue like this one, where the desugaring messed up the evaluation order of > and >=.  Whatever kinds of testing of these desugarings we currently have didn't seem to be sufficient.  For example, we may have written a unit test that a > b desugars to b < a but not realized that our "expected output" didn't actually have all the properties we wanted.
Describe the solution you'd like
The most promising approach I can think of that would be able to catch evaluation-order issues with desugarings is to write another version of the evaluator that directly evaluates expressions in a format in which most of the desugarings have not yet been performed.  The EST is probably close to what we want for this expression format.  Then, for a given EST e, we could compare the result of directly evaluating e to the result of converting e to an AST and evaluating that.
There are a few ways that the components of this plan could be broken down between Rust and Dafny.  A non-exhaustive list:

Do the whole thing in Rust and use DRT to compare the direct EST evaluation and the evaluation via EST-AST conversion.
Implement direct EST evaluation and EST-AST conversion in Dafny and prove that direct EST evaluation is equivalent to evaluation via EST-AST conversion.  Then use DRT to test that the Dafny EST-AST conversion is equivalent to the production one.

Describe alternatives you've considered
Just fix https://github.com/cedar-policy/cedar/issues/112, try to pay more careful attention when we add or change desugarings in the future, and hope for the best?  I don't know how important the problem actually is.
Additional context
No response
Is this something that you'd be interested in working on?

[ ] 👋 I may be able to implement this feature request
[ ] ⚠ This feature might incur a breaking change

One low hanging fruit we can do is to prove the equivalence after desugaring in Dafny. For instance, one proposed solution in #112 is to desguar a < b into !(a >= b), which we can prove something like eval(a < b) == eval(!(a >= b)).


Change subject Area to use the OMRS generic handlers

I am considering moving over to use the generic handlers for the Subject Area, as I was looking to extend to re use code in in the generic handlers for this fix. I then pickup the anchor classifications and visibility logic. Also the jsonld parser will now create these classifications when using the subject area OMAS API
My proposal is that :
I change the code to call GlossaryHandler GlossaryBuilder GlossaryCategoryBuilder GlossaryCategoryHandler GlossaryTermBuilder and GlossaryTermHandler. This would work for add, update, read, find
I then need to amend my mappers to map the beans to the OMAS
I still need logic could deletes and replace/update in the omas code. I want to reject delete requests of glossaries with content.
Additional handler content
I need to extend the omrs handler to include get/find category terms , category children, glossary terms, glossary categories and terms categorizations. All with filters and regex flags.
I need to consider what this means for the relationship APIs
I need to consider what this means for the graph API. getEntityNeighbourhood.
@mandy-chessell @cmgrote @planetf1 does this sound right or have I misunderstood / missed something?

I am thinking that I may not need to redo the existing subject area generics and could go straight to the omrs helper.

I have initial implementations for add , update, delete and get for each of the nodes.

for restore, there are no generic handler methods I could find. I am thinking it should as much as possible try to undo what the delete did.

Nodes
- if the restore is for a Term or Category only restore if the glossary is active - otherwise error.
- if the restore is for a Term or Category that is itself an anchor -for example if it has comments. Then the anchored content should be restored.
- For directly connected deleted, non anchored relationships to active entities. For example if there was a has-a relationship to a parent term, it seems reasonable  I restore this.
- restore should update the latestChange like update does
- restore should restore all associated deleted classifications (which may be more that were there at delete time).
- if the restore is for a glossary then we should restore
- any deleted classifications, and deleted relationships to active entities
- any deleted anchored content including any deleted classifications, and deleted relationships to active entities
Relationships
Only restore if both ends are active.
@mandy-chessell @cmgrote @planetf1 @lpalashevski Let me know if there is existing logic or your thoughts on this .

Updated https://github.com/odpi/egeria/issues/5465 to include the cponsideration of restores around TermAnchors, which delete the Term.


variable.name inconsistent

<EMAIL_ADDRESS>This is my code. In line 13, I specify a variable (storagevar) to the name of cloud variable.
In line 30, cloud set to encoded message: done
In line 36, using same cloud variabe:
bool(storagevar == variable.name)

Outputs false when I set the same variable in project to some value..
bool(storagevar in variable.name)

Outputs true however
(Is this how a glitch should be explained??)

How do I contribute to wiki too?

How do I contribute to wiki too?
I have 1 more doubt about scratchclient.. should I bombard you or just slowly ask 1 by 1

ask 1 by 1

@Quantum-Codes https://scratch.mit.edu/discuss/topic/506810/?page=5#post-5382267

It does work :) how to contribute to wiki? I dont see any edit button


Thank you very much

Dear Lucas,
I meet this problem, could you help me solve it:
[2020-04-30 14:17:43.285]: Listening on port 3002...
[2020-04-30 14:18:58.375]: Response received, adding network nodes
[2020-04-30 14:18:58.376]: undefined
undefined:1
undefined
^
SyntaxError: Unexpected token u in JSON at position 0
at JSON.parse ()
at Request._callback (/Users/qy/Desktop/PBFT-master/networkNode.js:469:21)
at self.callback (/Users/qy/Desktop/PBFT-master/node_modules/request/request.js:185:22)
at Request.emit (events.js:198:13)
at Request.onRequestError (/Users/qy/Desktop/PBFT-master/node_modules/request/request.js:881:8)
at ClientRequest.emit (events.js:198:13)
at Socket.socketErrorListener (_http_client.js:392:9)
at Socket.emit (events.js:198:13)
at emitErrorNT (internal/streams/destroy.js:91:8)
at emitErrorAndCloseNT (internal/streams/destroy.js:59:3)
at process._tickCallback (internal/process/next_tick.js:63:19)
Best wishes,
Yi

Hello Yi,
Could you send me the steps you took to start the nodes? A screenshot of your terminal is good enough.
Kind regards,
Lucas Abbade
On 30 Apr 2020, at 11:22, qy201901<EMAIL_ADDRESS>wrote:

Dear Lucas,
I meet this problem, could you help me solve it:
[2020-04-30 14:17:43.285]: Listening on port 3002...
[2020-04-30 14:18:58.375]: Response received, adding network nodes
[2020-04-30 14:18:58.376]: undefined
undefined:1
undefined
^
SyntaxError: Unexpected token u in JSON at position 0
at JSON.parse ()
at Request._callback (/Users/qy/Desktop/PBFT-master/networkNode.js:469:21)
at self.callback (/Users/qy/Desktop/PBFT-master/node_modules/request/request.js:185:22)
at Request.emit (events.js:198:13)
at Request.onRequestError (/Users/qy/Desktop/PBFT-master/node_modules/request/request.js:881:8)
at ClientRequest.emit (events.js:198:13)
at Socket.socketErrorListener (_http_client.js:392:9)
at Socket.emit (events.js:198:13)
at emitErrorNT (internal/streams/destroy.js:91:8)
at emitErrorAndCloseNT (internal/streams/destroy.js:59:3)
at process._tickCallback (internal/process/next_tick.js:63:19)
Best wishes,
Yi
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/LRAbbade/PBFT/issues/7, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AC3AGDOHEN4RARWF4KKNTXLRPGCRVANCNFSM4MVTNA3A.

Dear Lucas,
Thank you very much for the prompt help. It's my mistake. When I use "node networkNode.js master full <IP_ADDRESS> this", everything is ok. Thank you very much for the contribution!

Dear Lucas,
Could you kindly explain the purpose of this function:
function isEndpointEnabled(req, res, callback){
isBlockchainAvailabe ? callback() : res.json({note:" "})
}
Best wishes,
Yi

Dear Lucas,
Could you kindly explain the purpose of this function:
function isEndpointEnabled(req, res, callback){
isBlockchainAvailabe ? callback() : res.json({note:" "})
}
Best wishes,
Yi

When you start a node, it must retrieve the Blockchain information from the network, in a real scenario where the Blockchain might be running for a long time, it might be millions of blocks long, which could make this process take a long time, while the blockchain is being retrieved, the node cannot actively participate in the network (ie voting), so if it receives any request, it will only respond that it is not available. Once the blockchain has been completely downloaded, it can become an active member of the network, thus the flag isBlockchainAvailable will be set to true, and requests will be answered as expected.
Since there’s no real issue, I will close this one, if you need further explanations, feel free to e-mail me<EMAIL_ADDRESS>

Thank you very much!


Qwikswitch refactor & sensor

Description:
Refactor of qwikswicth (async/await/dispatchers/feedback from #12641) and adding first version of sensor.
As discussed on MyBB wireframe sensor support for QwikSwitch. Sensors need to implement their own logic over time in the qsSensor class in components/sensors/qwikswitch/. binary_sensor can be added later, but lets see how this general sensor starts....
Config changes:

sensors: added. Format is dictionary of {endtity_id: qs_id}, so adding a door sensorqwikswitch:
  sensors:
    door_sensor: '@id03'

cmd_buttons: now adds to the defaults and no need to include defaults anymore (backward compatible). Can be a list or csv list
Switches needs to be specified in the config or they will be discovered as lights. The " switch" in the name can be removed in QSUSB interface: BREAKING CHANGEqwikswitch:
  switches: ['@id01', '@id02']

Related issue (if applicable): fixes #
Pull request in home-assistant.github.io with documentation (if applicable): home-assistant/home-assistant.github.io#5045
Checklist:

[x] The code change is tested and works locally.
[x] Local tests pass with lazytox.

If user exposed functionality or configuration variables are added/changed:

[x] Documentation added/updated in home-assistant.github.io

If the code communicates with devices, web services, or third-party tools:

[x] New dependencies have been added to the REQUIREMENTS variable ([example][ex-requir]).
[x] New dependencies are only imported inside functions that use them ([example][ex-import]).
[x] New dependencies have been added to requirements_all.txt by running script/gen_requirements_all.py.
[x] New files were added to .coveragerc.

Hi there
When I start up HA as a custom component, I get the following error in the log file
File "/config/custom_components/qwikswitch.py", line 94, in async_setup
from pyqwikswitch.async_ import QSUsb

@MartinHjelmare thank you for the review, the asnync_added_to_hass is much more elegant!

kellerza, I removed the packages and downloaded the latest code based on your changes now.  Not sure if that was the right thing to do based on the below error in the log.
File "/usr/lib/python3.6/site-packages/homeassistant/helpers/entity_platform.py", line 82, in async_setup
SLOW_SETUP_MAX_WAIT, loop=hass.loop)
File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
return fut.result()
File "/usr/lib/python3.6/asyncio/futures.py", line 245, in result
raise self._exception
File "/usr/lib/python3.6/asyncio/tasks.py", line 180, in _step
result = coro.send(None)
File "/config/custom_components/light/qwikswitch.py", line 20, in async_setup_platform
devs = [QSLight(qsid, qsusb) for qsid in discovery_info[QWIKSWITCH]]
File "/config/custom_components/light/qwikswitch.py", line 20, in
devs = [QSLight(qsid, qsusb) for qsid in discovery_info[QWIKSWITCH]]
File "/usr/lib/python3.6/site-packages/homeassistant/components/qwikswitch.py", line 58, in init
from pyqwikswitch import (QS_ID, QS_NAME, QSType, PQS_VALUE, PQS_TYPE)
ImportError: cannot import name 'PQS_VALUE'

@ipodmusicman you will have to add all 4 qwikswitch files to the custom_components folder since they all changed.  The error show that the old components/qwikswitch.py is loaded by HASS (most likely it dd not find this custom version/its in the wrong folder etc)
config\custom_components\qwikswitch.py
config\custom_components\switch\qwikswitch.py
config\custom_components\sensor\qwikswitch.py
config\custom_components\light\qwikswitch.py

kellerza,
I grabbed all 4 files from the beginning, updating them as you pushed changes during the day.  I also deleted the site-packages just in case before restart.
With the component in place, my one light isn't appearing in HA any more and when I remove the custom_components and restart, my light is back.
With the sensor in place, I get the following:
2018-03-29 16:25:53 ERROR (MainThread) [homeassistant.components.light] Error while setting up platform qwikswitch
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/homeassistant/helpers/entity_platform.py", line 82, in async_setup
SLOW_SETUP_MAX_WAIT, loop=hass.loop)
File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
return fut.result()
File "/usr/lib/python3.6/asyncio/futures.py", line 245, in result
raise self._exception
File "/usr/lib/python3.6/asyncio/tasks.py", line 180, in _step
result = coro.send(None)
File "/config/custom_components/light/qwikswitch.py", line 20, in async_setup_platform
devs = [QSLight(qsid, qsusb) for qsid in discovery_info[QWIKSWITCH]]
File "/config/custom_components/light/qwikswitch.py", line 20, in
devs = [QSLight(qsid, qsusb) for qsid in discovery_info[QWIKSWITCH]]
File "/usr/lib/python3.6/site-packages/homeassistant/components/qwikswitch.py", line 58, in init
from pyqwikswitch import (QS_ID, QS_NAME, QSType, PQS_VALUE, PQS_TYPE)
ImportError: cannot import name 'PQS_VALUE'
I removed the sensor from the config and got the following below:
018-03-29 15:56:26 ERROR (MainThread) [homeassistant.setup] Error during setup of component qwikswitch
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/homeassistant/setup.py", line 142, in async_setup_component
result = await component.async_setup(hass, processed_config)
File "/config/custom_components/qwikswitch.py", line 99, in async_setup
from pyqwikswitch.async import QSUsb
ModuleNotFoundError: No module named 'pyqwikswitch.async_'
2
Also to note, that with the sensor in place, even with the errors were occurring in the log, I saw the badge icon at the top and on clicking on it saw the various fields and of course the data block change accordingly as a opened and closed the various channels on the imod.
Does one generally display sensors as badges or in cards by default?
Would I be able to assign a friendly name to the sensor within the qwikswitch config or would I need to do a customization?
Is it possible to create separate sensors per channel?  A door sensor or movement sensor only has "1 channel", but an imod can have up to 5 channels.  A suggestion on the conifg - you'll need to guide on what is best practice as this is only a suggestion:
qwikswitch:
url: http://localhost:2020
sensors:
- entity: imod_arm
friendly_name: 'Alarm Armed'
id: '@12345'
channel: 1
- entity: imod_disarm
friendly_name: 'Alarm Disarmed'
id: '@12345'
channel: 2
- entity: door_sensor
friendly_name:  'Garage Door'
id: '@22222'
Let me know what you think?
Btw, I got a response from QwikSwitch yesterday.
The first byte of the data block indicates the sensor type:
4e = imod
46 = Door sensor
I've asked for a comprehensive list including the motion sensor and any other sensors they have like temperature and humidity sensors.  I've also asked for example messages if they have for the temp and humidity sensors.
The second byte is the firmware version
The proceeding bytes as per our conversation on MyBB whereby:
for an imod = third and forth byte indicates which channels are open/closed as well as which channel was affected in a status change - see our discussion om MyBB
for a door sensor = 00 = Open, 64 (100 decimal) = Closed

@ipodmusicman  (I added three backticks ``` to your comment for code blocks)
From the errors, unfortunately we cannot do custom_components, since
/config/custom_components/light/qwikswitch.py imports homeassistant.components.qwikswitch which is /usr/lib/python3.6/site-packages/homeassistant/components/qwikswitch.py
So you either need to patch qwikswitch in to /usr/lib/python3.6/site-packages/homeassistant/components/qwikswitch.py. The subcomponents (light,switch,sensor) can live in custom_components
The second error seems to show that your don't have the latest library again...?
Ideally we should merge this and you can then use dev for your tests.... lets just wait for final ok from @MartinHjelmare
BTW, see the documentation link for initial config today (incl channel), your might be cleaner

kellerza,
Now that this merge is done, what is the best way for us to continue our ongoing conversations?
I installed HA on Ubuntu so that I can give it a test drive and get to know the platform so I'd imagine that since it is deviating from the recommended set up on a Pi, things seem to be getting a bit mixed up. :)  I plan to purchase a Pi-3b within the next month or so so that I can set things up properly.
I saw the channel addition to the documentation.  Are you going to consider my config suggestion for the sensors?  I'll see how I can expand my skills to Python as I come from a Java background to assist in putting something in place that can be used to interpret the data block in the method below based on the sensor type as well as the bytes themselves so that the method either returns open or closed.   For a door sensor (and probably a motion sensor as well), it should be as easy as returning either open or closed based on the value of the third byte, but for the imod, it is different as one would need to know which channel the sensor is configured for to determine which bit to use to decide whether it is open or closed.
def state(self):
    """Return the value of the sensor."""
    return self._val.get('data', 0)

If you want to suggest an enhancement please open a feature request in the Feature Requests section of our community forum.
If you want to discuss things before opening a PR you can make an RFC issue.
Merged PRs should not be used for enhancement discussion.
Thanks!


sorry newbe :|  where do i find log files / feed back to confirm doing what i expect

running it within cygwin on windows so far so good at least i think so.
where / how do i view the logs that it looks like it is logging so i can see its progress?
i'm assuming it must be about half way through backing up my folders but have no feedback to make sure it is getting the correct files.
thank you in advanced

Just to be clear, do you see the basic logging where it shows you what directory it's backing up? But you'd like logging for each file that's backed up, so you can confirm everything you expect is being saved properly?
There are two solutions:

Add -v to your tarsnap options, so tarsnap will print the name of each file it saves
Manually read the list of files in one of the backups acts makes, using a command like tar tf <backupname> which will list the files within the backup

that is all the information i'm seeing, i can see network traffic for the tarsnap service so i know it is running. but been a number of hours and wanting an estimation of how long will take.
1 ) missed oportunity to -v as already working,
2) how do i go about this? where are the tar files?
see screenshot of what i'm seeing

You can't change the acts options while it's running, but you could cancel the run and start it again, if you wanted.
The tar files are stored in the tarsnap cloud, you can list all tarsnap archives with tarsnap --list-archives

Also, note that you can't pass arguments to acts directly (i see you tried to run acts --dry-run, which will have no effect). You should put these argument in your acts.conf file (see the README for more info).

yer i worked out that didn't do anything told you i was a newbie :(
i've turned on debug level feed back and set tarsnap="tarsnap -v" in config
and still this is all I'm seeing, is that normal? or should the -v option be providing more feed back?

thank you again for your help so appreciated.

p.s. thats after i stopped it and restarted it with the new config.

Try adding -v to tarsnapbackupoptions instead
On Thu, 7 Jul 2016, 1:41 PM mrhut10<EMAIL_ADDRESS>wrote:

yer i worked out that didn't do anything told you i was a newbie :(
i've turned on debug level feed back and set tarsnap="tarsnap -v" in config
and still this is all I'm seeing, is that normal? or should the -v option
be providing more feed back?
[image: acts progress feedback2]
https://cloud.githubusercontent.com/assets/20330237/16641894/75d357a4-4448-11e6-8b4f-13f090c1329a.PNG
thank you again for your help so appreciated.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/alexjurkiewicz/acts/issues/16#issuecomment-230971102,
or mute the thread
https://github.com/notifications/unsubscribe/AAXKda059twV1MQ2QSHO3yObTYSnwikPks5qTHVdgaJpZM4JGruB
.

I did that and added dry run, but still only seeing details from your script,
is there a way to raise feedback that tarsnap is providing?
thats what i'm seeing, and sorry if i'm missing the point :(

well, it looks like a few backups have completed now, so it might be easiest to inspect the tarsnap archive now, like tarsnap -tf DESKTOP-94947K0-monthly-2016-07-07_03:53:22-cygdrivevwork

looks like i may have fixed it,
within your script i put I added a "| tee progress.txt"
so when i open that file i can see it traversing through file system and feel confident it is working.
thank you again :)
this is the line that i've added the " | tee progress.txt"
if ! output="$($tarsnap -c -f "$archivename" -C / $tarsnapbackupoptions "$dir" 2>&1 | tee progress.txt)" ; then

is awesome as i know there are around 3000 files, and currently up to 2054 lines in file so i'm around 60% ish through the files structure

thank you again, i'll close off issue.
love your work :) thank you for creating.


502 Bad gateway

I've been having a problem where some apps forward properly but others do not. Returning Bad Gateway 502. I think this may be related to missing headers.   Can you confirm that Taxy adds the  X-Forwarded-For and X-Forwarded-Proto headers? I looked but could not find a configuration option to turn that on.

I've fixed some inconsistent behavior with the x-forwarded-* headers in v0.3.31.
Feel free to reopen the issue if the error persists.


Path back to using released tl crate dependency?

As required by Fedora’s guidelines for bundling – do you anticipate being able to go back to using the released tl crate at some point? It looks like all that’s needed is for https://github.com/y21/tl/pull/69 to be merged and released – is that correct? Thanks!

Yes that sounds correct — we'd love to use the released tl crate but we also want to deliver that fix to our users.

Thanks! Closing this since the question is adequately answered.


Loadbalancer role (keepalived/haproxy)

Added load-balancer role for HA master configuration of cluster.
When there is more than one master node, an haproxy and leader-elected keepalived pod (via unicast) is run on each master node. A VIP is specified in group_vars for the apiserver. Haproxy uses round-robin load balancing with SSL pass-through.
This PR depends on #761. I'll make changes here as that evolves.
/cc: @danehans @rutsky @eparis

@adamschaub a couple of question:

are you using haproxy to balance the traffic to the api servers?
why not use keepalived for that too using DR?

@aledbf Great question. As it is currently configured, haproxy+keepalived (forwarding the TCP connection) is functionally similar to keepalived DR. I followed haproxy+keepalived setup mainly as it was the more common setup I found, and partly because we can configure haproxy for ssl-termination which has some benefits if we expose these apis on a public network (perhaps useful for "Ubernetes" [1])
Admittedly I'm no load balancing expert, very open to discussion/opinions. Input on this @danehans?
[1] https://github.com/kubernetes/kubernetes/blob/master/docs/proposals/federation.md

@danehans Updated dependencies so master depends on lb role, unified all the port bindings, removed kube-proxy, added kube-master hostname override back in, updated vagrant file to include kube_apiserver_interface, etc.
Still need to implement haproxy status check in keepalived.conf. For now, master/slave weighting should get us by.

recomputing cla status...

[APPROVALNOTIFIER] The Following OWNERS Files Need Approval:

ansible

We suggest the following people:
cc @eparis
You can indicate your approval by writing /approve in a comment
You can cancel your approval by writing /approve cancelin a comment


Add domain model

While pydicom provides a great generic model for DICOM datasets, I find it more convenient to work with a domain model that represents the IODs and Sequences.  This allows one to take advantage of property based code completion (a.k.a. "Intellisense").
The IODs and sequences were created using code generation based on the json files that the innolitics DICOM project creates
https://github.com/innolitics/dicom-standard/tree/master/standard
With some manual post processing to eliminate duplicates.
There are still some aspects that need to be tidied up where the same sequence contains different elements in different IODs or just in different parent sequences.
The code generator for the domain model will be placed in a separate project/repo
The domain model was used to model the RT Ion Plan and RT Ion Beams Treatment Records IODs to assist in synthesising "perfectly delivered" treatment records from a plan.  Those treatment records are intended to be used in the TDW-II workflow as one of the final steps (Store Treatment Delivery Results to OST [RO-63]).

Claude generated classes didn't work.  I wrote my own code generator and overwrote what I got from Claude.  Although I did use Claude to help me tweak the specific code content (vs. constructing the object tree and visiting it, which was based on AnyTree and the innolitics/dicom-standard json files).


Is there any way to disable scroll horizontal to dismiss preview mode ?

Is there any way to disable scroll horizontal to dismiss preview mode ?
Thanks :)

Hi,
not at the moment,  but it's a good idea. It would be very easy to allow this to be configured from the configuration.
I will add this to the list of 3.0 features.
Thanks :)

@Krisiacik was this solved?

I don't think it has been implemented yet. PRs are welcome @biizc1150 :)

This is now implemented. For now, it's part of master branch.


docker-gc ignores EXCLUDE_FROM_GC on Docker 1.10

After upgrading to Docker 1.10, docker-gc ignored my EXCLUDE_FROM_GC setting and removed nearly all my local Docker images.

It sounds to me like Docker 1.10 changes the IDs of all of your images when migrating to the new storage format, so your excludes file will need to change it's contents.

My excludes file only has labels, not IDs, e.g.:
debian:8
python:3\.5-alpine
rethinkdb:latest

Sorry to hear it caused an issue for you :disappointed: To be quite honest though at Spotify we are a few versions of Docker behind, and AFAIK Docker 1.10 is just freshly released, so I am not entirely surprised that there may be conflicts - which sound like the new storage engine could be at play.

It wasn't a huge deal; I noticed it on my local dev machine, and it was nothing that couldn't be fixed by re-pulling and re-building. :-)

This PS fixes the issue https://github.com/spotify/docker-gc/pull/93 for docker version >=1.10 deployments.
Works with docker pre 1.10


[Bug] Not able to install lmdeploy

Checklist

[ ] 1. I have searched related issues but cannot get the expected help.
[ ] 2. The bug has not been fixed in the latest version.
[ ] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.

Describe the bug
I'm Not able to install this library
(mindsearch) (base) pavankumar@Pavans-MacBook-Pro MindSearch % pip install lmdeploy
ERROR: Could not find a version that satisfies the requirement lmdeploy (from versions: none)
ERROR: No matching distribution found for lmdeploy
Reproduction
pip install lmdeploy
Environment
active environment : mindsearch
    active env location : /opt/homebrew/Caskroom/miniconda/base/envs/mindsearch
            shell level : 2
       user config file : /Users/pavankumar/.condarc
 populated config files : /Users/pavankumar/.condarc
          conda version : 24.5.0
    conda-build version : not installed
         python version : 3.12.4.final.0
                 solver : libmamba (default)
       virtual packages : __archspec=1=m1
                          __conda=24.5.0=0
                          __osx=14.6.1=0
                          __unix=0=0
       base environment : /opt/homebrew/Caskroom/miniconda/base  (writable)
      conda av data dir : /opt/homebrew/Caskroom/miniconda/base/etc/conda
  conda av metadata url : None
           channel URLs : https://repo.anaconda.com/pkgs/main/osx-arm64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/osx-arm64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /opt/homebrew/Caskroom/miniconda/base/pkgs
                          /Users/pavankumar/.conda/pkgs
       envs directories : /opt/homebrew/Caskroom/miniconda/base/envs
                          /Users/pavankumar/.conda/envs
               platform : osx-arm64
             user-agent : conda/24.5.0 requests/2.32.2 CPython/3.12.4 Darwin/23.6.0 OSX/14.6.1 solver/libmamba conda-libmamba-solver/24.1.0 libmambapy/1.5.8 aau/0.4.4 c/. s/. e/.
                UID:GID : 501:20
             netrc file : None
           offline mode : False

Error traceback
No response

It doesn't support macOS.


Credential Exchange - 'cred_def_id': ['Missing data for required field.'] - aries-agent calling create  method Error: Request failed with status code 422

The issuer gets stuck while issuing credentials to the BC wallet agent. Any help on how to resolve this error is much appreciated. Thanks in advance!

Browser Console logs:

Server Logs:
I see the following error in the logs.. marshmallow.exceptions.ValidationError: {'cred_def_id': ['Missing data for required field.']}
api_1               | debug: Creating new credential exchange
agent_1             | 2022-08-29 02:35:59,651 aries_cloudagent.admin.server ERROR Handler error with exception: Unprocessable Entity
agent_1             |
agent_1             | =================
agent_1             | Traceback (most recent call last):
agent_1             |   File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/webargs/asyncparser.py", line 90, in parse
agent_1             |     result = schema.load(parsed)
agent_1             |   File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/marshmallow/schema.py", line 723, in load
agent_1             |     data, many=many, partial=partial, unknown=unknown, postprocess=True
agent_1             |   File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/marshmallow/schema.py", line 904, in _do_load
agent_1             |     raise exc
agent_1             | marshmallow.exceptions.ValidationError: {'cred_def_id': ['Missing data for required field.']}
agent_1             |
agent_1             | During handling of the above exception, another exception occurred:
agent_1             |
agent_1             | Traceback (most recent call last):
agent_1             |   File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aries_cloudagent/admin/server.py", line 159, in ready_middleware
agent_1             |     return await handler(request)
agent_1             |   File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aries_cloudagent/admin/server.py", line 196, in debug_middleware
agent_1             |     return await handler(request)
agent_1             |   File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aiohttp_apispec/middlewares.py", line 34, in validation_middleware
agent_1             |     schema["schema"], request, locations=schema["locations"]
agent_1             |   File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/webargs/asyncparser.py", line 95, in parse
agent_1             |     error, req, schema, error_status_code, error_headers
agent_1             |   File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/webargs/asyncparser.py", line 108, in _on_validation_error
agent_1             |     await error_handler(error, req, schema, error_status_code, error_headers)
agent_1             |   File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/webargs/aiohttpparser.py", line 166, in handle_error
agent_1             |     content_type="application/json",
agent_1             | aiohttp.web_exceptions.HTTPUnprocessableEntity: Unprocessable Entity
api_1               | Error in aries-agent calling create  method Error: Request failed with status code 422
api_1               |     at createError (/opt/app-root/src/node_modules/axios/lib/core/createError.js:16:15)
api_1               |     at settle (/opt/app-root/src/node_modules/axios/lib/core/settle.js:17:12)
api_1               |     at IncomingMessage.handleStreamEnd (/opt/app-root/src/node_modules/axios/lib/adapters/http.js:269:11)
api_1               |     at IncomingMessage.emit (events.js:326:22)
api_1               |     at endReadableNT (_stream_readable.js:1241:12)
api_1               |     at processTicksAndRejections (internal/process/task_queues.js:84:21) {
api_1               |   config: {
api_1               |     url: 'http://agent:8024/issue-credential/send-offer',
api_1               |     method: 'post',
api_1               |     data: '{"connection_id":"7522936f-348c-42c0-8dbf-3710688a3801","comment":"Credential offer from Issuer Name","credential_preview":{"@type":"did:sov:BzCbsNYhMrjHiqZDTUASHg;spec/issue-credential/1.0/credential-preview","attributes":[{"name":"country","value":"Canada","mime-type":"text/plain"},{"name":"issued","value":"2022-08-29T02:35:05.201Z","mime-type":"text/plain"},{"name":"given_names","value":"Dinesh","mime-type":"text/plain"},{"name":"family_name","value":"Admin","mime-type":"text/plain"},{"name":"birthdate","value":"1980-01-01","mime-type":"text/plain"},{"name":"street_address","value":"asdfasfasf","mime-type":"text/plain"},{"name":"postal_code","value":"B3K 2S3","mime-type":"text/plain"},{"name":"locality","value":"Halifax","mime-type":"text/plain"},{"name":"region","value":"NS","mime-type":"text/plain"}]},"auto_issue":false}',

I managed to resolve that error.. Think the issue was due to... switching back and forth between local mode and dev mode. I think it messed up the cred_def. After starting over from scratch I no longer see the error.
Started the service in this order:

Von-network
issuer-kit in local mode
BC Wallet (with metro port set to 10001 to prevent default port 8081 clashing with issuer-kit  - export RCT_METRO_PORT=10001)


closeOnBackdropClick without carousel component

I'm currently using the library in multiple places on my site with no issues. However when using the modal without the carousel component I can't get closeOnBackdropClick to work. I'm using the modal to display a form.
<ModalGateway>
               {this.state.formOpen ? (
                 <Modal onClose = {this.closeForm} >

X

                  <form action="apistuff" method="POST" target="_blank">
                  <input type="email" name="email" placeholder="enter your email" />
                  <input type="text" name="name" placeholder="enter your name" />
                  <button>Submit</button>
                  </form>

                 </Modal>
               ) : null}
             </ModalGateway>

Looking in react dev tools it is set to true and and pressing the esc key closes the modal just fine. Has anyone come across this issue before?

I'm having the same problem. Tried adding my own "click outside" within the modal to force close, but as soon as I dispatch the close() function the modal automatically re-opens... Seems to be something withing the modal component's own state control.
I'm also having this problem with the Carousel component.


Better error messages when wrong credentials is used or wrong Uri is registered

Prerequisites

[X] Write a descriptive title.
[X] Make sure you are able to repro it on the latest released version
[X] Search the existing issues.

Steps to reproduce
Using GitLab NuGet repository version 3 that needs authentication to work.
Most of the messages says nothing about wrong credentials, missing credentials or even when wrong Uri is used.
Registered to GitLab using Register-PSResourceRepository, set up Credential object in an array to use.
Used Update-PSResource, Find-PSResource and Install-PSResource in a self-published package at our GitLab NuGet-repository.
Expected behavior
To get some sort of error that tells me I missed to use the -Credential switch, used wrong password or my Credential object was $null. Also a message if I've registered the wrong Uri or the Uri is changed after the Uri is registered making the repo inaccessible.

My issue is getting from no understandable errors to strange errors that most of the time is due to wrong credentials or something wrong with the registererd Uri

Actual behavior
One example when Using the wrong credential-object. I've forgot to set it.

The error that surfaced:

Install-PSResource: Package 'DemoModule' with requested version range '(, )' could not be found in any trusted repositories

Another error I got was:
Install-PSResource: Unable to successfully install package 'MiunVM': 'Could not find a part of the path...

When running with -verbose I found infamouse  retrieving resource from repository: Unable to load the service index for source....```
Before running in -verbose I tried Find-PSResource and there I get not complaing about wrong credentials. It just show some old listings from when I used working credentials. Adding -Verbose does not give any more information.

### Error details

_No response_

### Environment data

```powershell
PS C:\Program Files\PowerShell\Modules> Get-Module PowerShellGet; $PSVersionTable

ModuleType Version    PreRelease Name                                ExportedCommands
---------- -------    ---------- ----                                ----------------
Binary     3.0.18     beta18     PowerShellGet                       {Find-PSResource, Get-PSResource, Get-PSResourceR…

Key   : PSVersion
Value : 7.3.1
Name  : PSVersion

Key   : PSEdition
Value : Core
Name  : PSEdition

Key   : GitCommitId
Value : 7.3.1
Name  : GitCommitId

Key   : OS
Value : Microsoft Windows 10.0.22621
Name  : OS

Key   : Platform
Value : Win32NT
Name  : Platform

Key   : PSCompatibleVersions
Value : {1.0, 2.0, 3.0, 4.0…}
Name  : PSCompatibleVersions

Key   : PSRemotingProtocolVersion
Value : 2.3
Name  : PSRemotingProtocolVersion

Key   : SerializationVersion
Value : <IP_ADDRESS>
Name  : SerializationVersion

Key   : WSManStackVersion
Value : 3.0
Name  : WSManStackVersion

Visuals
No response

Thanks @rogermartensson for opening this issue!  We'll investigate and we're specifically curious if this is a GitLab issue or if it happens with other repositories as well.

I do not know if this is a GitLab issue although my google-fu seems find mostly references to GitLab.
i believe it may be more of a authentication issue than a service provider issue. Maybe gitlab needs more authentication in the nuget v3-api than GitHub?
I use mostly private repositories and that might also make the problem more visible.
One thing that I believe is GitLab specific is if you have a group of repositories you can get a nuget-uri for that group. That one I believe requires authentication.


AD FS/Deployment: URL & description corrections

From issue ticket #577 (Checklist item # 10 wrong link. Must be "Create a Claims Provider Trust"):
The links and their descriptions in the Reference column do not match the "Create a Claims Provider" step (step number 10), but instead point to the page about "Create a Relying Party Trust".
This is clearly a mismatch.
Thanks to Jānis Veinbergs (@janis-veinbergs) for reporting this issue and for providing the correct URL/page link.
Closes #577

#sign-off


fix: page headers

Closes FE-29
Fix page headers in Transaction / Account / Block page

On your pr the mobile and desktop nav bars appear around width 950px. This doesn't appear in the main vercel deployment. But you didn't modify the nav bar component. 🤔

create an issue for us to explore better, it's not related to this PR for sure

https://linear.app/fuel-network/issue/FE-41/both-nav-bars-appearing-at-width-950px


Be more resillient in cases of mysql errors

We are using mysql-statsd to monitor a remote db which tends to fail every now and then because of unreliable internet.  This patch makes the daemon and the mysql thread more able to deal with these problems.
This is a work in progress which we're currently trying out.  You should probably not merge this for a few days in case we find some problems with it.  I wanted to make the PR early so you can have some idea what I'm doing.
Specifically:

manager: if one of the threads (including the main thread) crashes the daemon will terminate gracefully

I did consider trying to make it restart but it seems like that should be more effectively done with monitoring tools (which will give better reporting) and in the mysql thread which will be more granular.
Also it would be more resource friendly to use some kind of event to detect the thread has crashed or if we're intentionally quitting but I couldn't work out how to do it.

mysql: if there is a 2006 "gone away" error, we will close and reconnect.

This is the most common problem when the connection isn't reliable but I expect I will find others which want a reconnect too.  I don't want to just reconnect by default to avoid spamming too many connections.
You can reproduce this problem by running SET wait_timeout = 0 at some point.

mysql: any other error will wait until a limit of consecutive query errors is reached before giving up

mysql: reconnect errors must be consecutive before we'll give up.

This is backwards incompatible but seems more sensible than the current behaviour.

mysql: the default is to terminate the thread when reaching the reconnect limit or the error limit.

Not sure if you want to add some configuration for this because this is backwards incompatible.  For errors it doesn't make any difference because previously the daemon will just hang after any exception.

We've been running this patch in production since I wrote the pull request and mysql-statsd hasn't stopped reporting metrics so I'm happy it hasn't caused any catastrophes and you could consider it for merging.
Please let me know if you'd like me to make any changes.

Hi James,
Thanks for the pull request. I have merged it, but this was the last merge that will happen to this repo.
I will be leaving this company at the end of the week so I will be no longer maintaining the Spil Games repo. On the positive side: I will continue the project with a new repo under my own company:
https://github.com/db-art/mysql-statsd
Hope to see you continue to contribute there as well.
Cheers,
Art

Thanks, I will keep this in mind.

Hold your horses. Just found out I might actually be able to transfer the repo. So I'll try that first. ;)
Art

Success! :+1:


Error: Expected undefined to be a GraphQL schema.

error - Error: Expected undefined to be a GraphQL schema.
{
  err: Error: Expected undefined to be a GraphQL schema.
      at assertSchema (/briOS/node_modules/graphql/type/schema.js:47:11)
      at validateSchema (briOS/node_modules/graphql/type/validate.js:42:28)
      at assertValidSchema (briOS/node_modules/graphql/type/validate.js:66:16)
      at assertValidExecutionArguments (briOS/node_modules/graphql/execution/execute.js:150:35)
      at executeImpl (briOS/node_modules/graphql/execution/execute.js:98:3)
      at Object.execute (briOS/node_modules/graphql/execution/execute.js:60:63)
      at /node_modules/@apollo/link-schema/lib/index.js:19:39
      at new Subscription (briOS/node_modules/zen-observable/lib/Observable.js:197:34)
      at Observable.subscribe (node_modules/zen-observable/lib/Observable.js:279:14)
      at briOS/node_modules/@apollo/client/link/error/error.cjs.js:16:42
}

PS: Please provide README.md and .env.local.template

Are you running this locally?

yes

Gotcha, I'm not quite sure what's going wrong here, but I'm not going to be able to offer much support for folks cloning this.


is this available for mac

can i get this on a macbook air?

can i get this on a macbook air?

No, Bloxstrap is not cross-platform whatsoever.

@mickymatthews might work with wine or proton.

@mickymatthews might work with wine or proton.

Wine support is blocked, do not use Wine or any forks like Proton.

They broke grapejuice and vinegar again?


Temporal embeddings with output_metric?

TLDR: Could the new output_metric feature be used to produce a umap-embedding with one interpretable axis?
Thanks for the library in general, and the great maintainance!
I'm trying to improve on embeddings with a temporal axis, as discussed here:
https://github.com/lmcinnes/umap/issues/137
I was wondering if this was possible by defining an embedding space (https://umap-learn.readthedocs.io/en/0.4dev/embedding_space.html), in which one dimenson is fixed to the timestamps of the datapoints, while they can freely arrange themselves on the other dimension(s).
Somewhat like what is happening here:
https://blockbuilder.org/MNoichl/8fa55c9b03008a1138f22be87444fe19
Is this possible, and how could one go about implementing it?

Off the top of my head I can't think of a way to make this happen; but I've found that the output_metric options can be quite subtle, and there are often somewhat less obvious ways to make use of it to get what you want.
I'll try to give it some thought and get back to you.

Thank you for having a look! Would it help if I provided a little toy-dataset?

Actually yes, a toy dataset (with some expected sorts of results) would be helpful. Thanks.

I hope the attached file is useful. It's citation-data of papers in philosophy and economics ('CR') and their publication-year ('PY'). I would expect a pattern of two clusters, somewhat different in structure, one for econ, and one for philosophy. The philosophy cluster can be expected to be more dense then the econ-one, as it's drawn from a smaller subfield. There will also be a tight cluster of datapoints with missing data. Basically something like this:

These should flow alongside eachother with little (although not necessarily no) interaction. And the econ cluster will probably go way longer back in time.
I hope that this is useful. If can improve it in some way, please tell me, and thank you for your time.
The graphic was produced from the file using the following code:
import pandas as pd
import numpy as np
import matplotlib.pyplot as plt

import umap
from sklearn.feature_extraction.text import CountVectorizer
from sklearn.decomposition import TruncatedSVD

data = pd.read_pickle('econ_phil_bib_coupling.pkl')

corps = [[str(n) for n in x] for x in data['CR']]
vec = CountVectorizer(tokenizer=lambda doc: doc, lowercase=False)
bow = vec.fit_transform(corps)
SVD = TruncatedSVD(n_components= 200, n_iter=7, random_state=42)
XSVD = SVD.fit_transform(bow)
twodmap = umap.UMAP(n_components= 2,metric="cosine",n_neighbors=20,min_dist=0.1,verbose=True).fit(XSVD)
plt.scatter(twodmap.embedding_[:,0],twodmap.embedding_[:,1], s=5, linewidth=0, c='black', alpha=0.5)

econ_phil_bib_coupling.zip

So i chatted with colleagues, and we have a plan that might work. I haven't had a chance to try it. The idea is as follows:
define a custom distance with gradient function for the output_metric as 2D euclidean distance, except that the gradient for the x-coordinate is set to 0.  If you then initialize the embedding with the x-coordinates given by time, the optimization will be able to move points in the y-direction, but not the x-direction (and thus not change the time coordinate), while still measuring all the distances in the the full 2D plane.
As I said, I haven't had a chance to try it, so I have no idea how well this may or may not work, but it certainly seems like a plausible approach.

Thank you for your answer! So this what I came up with. Here is the normal umap of the dataset from above:

Using the following custom gradient, I got the result below (same clusters):
@numba.njit(fastmath=True)
def adjusted_euclidean_grad(x, y):
    g = np.zeros_like(x)
    result = 0.0
    for i in range(x.shape[0]):
        result += (x[i] - (y[i])) ** 2
        g[i] = (x[i] - y[i])
    dist = np.sqrt(result)
    gradient = g/(1e-6 + dist)
    gradient[0] = 0
    return dist, gradient

init = data.PY.values.reshape((-1,1))
init = np.append(init,np.random.rand(len(init),1), axis=1)

timed_mapper = umap.UMAP(output_metric=adjusted_euclidean_grad,
                         metric="cosine",
                         n_neighbors=25,
                         min_dist=0.01,
                         random_state=42,
                         verbose=True,
                         init=init).fit(XSVD)

Is this basically what you had in mind? I think it looks already pretty good.
One issue I ran into was, that the correct cluster seperation/consistency tends to be quite bad in larger datasets, unless I choose a very high n_neighbours (<100). But this gets computationally too expensive for large datasets. Is there another parameter that might be worth playing around with?
Thank you for your help!

It looks like what I had in mind. In terms of performance -- the custom metrics are just slower because they have to take a different more generic code path. I don't think there are any easy ways to speed that up significantly in the short term. Sorry.

It's not that bad, I can still work well with it.
So, thank you again for all your aid, I'll close the issue.


Optional Constraint 2: can only use in "entry points"

https://github.com/MylesBorins/proposal-top-level-await#optional-constraint-top-level-await-can-only-be-used-in-modules-without-exports
Another alternative to "only in modules without exports" is "only entry points" - in a browser, this would be "script tags" or "files used to run a Worker" ; in node, the thing used to start an app; and in both, anything that's import()-ed.
There are some drawbacks to this, including that you could write a file that could only be dynamically and not statically imported, but I think it's worth calling out the alternative (even if that's to explain "why not").

This doesn't work because a file can be used as both an entry point and a dependency.

@domenic sure; but when used as one, it could parse, and as the other, be an early error, no?

At least on the web we do not re-parse/instantiate/evaluate the same URL multiple times; doing so would interfere with the module map mechanism.

I don't really see what the problem would be in plumbing "no entry points" through to HTML. It'd be more bookkeeping, sure, but it all seems doable. But anyway, the explainer documents the motivation for why we are not proposing this restriction, so I'm closing this issue.


Better way to detect if docker host is running

Hello
I'm running into a problem using the generic driver (I believe this applies to other drivers too). docker-machine fails to detect that my docker host is running because it checks the output of netstat -an, which is locale dependent. I'm currently writing from Brazil, and sometimes the default linux distro language pack is downloaded according to the Locale.
I know that this is an easy fix on my part (just re-install ubuntu using english language pack), but I believe that docker-machine can use a more robust way to tell if the docker host is running or not.
I've located the piece of code which is responsible for this error, it happens that the "LISTEN" parameter is hardcoded on the regex match:
https://github.com/docker/machine/blob/8046e13683f6c40cfa55ae106bba5f4f4d87f7ea/libmachine/provision/utils.go#L253
Since the docker host port is until now hardcoded, can we run the regex based on the port it's listening on, instead of the status?
Thanks

I'm open to suggestions. I agree that using netstat is not really ideal, but any solution needs to account for the situation where SSH access is available, but direct access to <ip>:2376 isn't (in which case machine can detect docker is running and finish provisioning anyway, alerting the user to the fact that the port is blocked).  This kind of IP range blockage is common with users running Docker Machine alongside VPN or other aggressively controlling network environments.

I'm really not an expert with this, but would not a ´´telnet´´ (or anything similar) suffice to determine if docker is running? This can be run inside the machine being provisioned and also on the client machine. It could determine, as you say, that the port is blocked and therefore generating more robust information to the user.

@paulovictorv telnet isn't installed by default on all OS like netstat. IMHO netstat is the best choice but it could be improved to avoid OS with default language different from english.
There is one case in which checkDaemonUp will fail:

If dockerPortis 2376 and machine has port 23760 listening, matchNetstatOut will return true.

I'm currently testing a fix and will push a PR soon.

Yep, I'm aware of that, I was trying to come up with ideas similar to using telnet to check if the port is open. I've used a dummy code in some of my unit tests that tries to open a socket to a specified port and keeps trying until a connection is accepted or a timeout is reached.
But I guess that checking the output of netstat for the port works.


Upload library to Maven Central Repository

I need to build upon this library but it looks like it is not available on the Maven Central Repository. I think it would be great to have this library released as a versioned JAR artifact rather than cloning and building manually.

We've been uploading artifacts to a maven repository at downloads.mesosphere.com. You should be able to configure your project to use that, with something like these examples (gradle configs):

dcos-cassandra-service
dcos-kafka-service

Oh perfect. Sorry about the confusion. I think it is worth mentioning in the README. :) Thanks!


[Bug]: Actual docker won't start

Verified issue does not already exist?

[X] I have searched and found no existing issue

What happened?
Hallo,
I have successfully set up a docker container with actual, but it won't load the webpage:

What error did you receive?
All the time.
My docker compose:
"version: '3.3'
services:
actual-server:
    image: actualbudget/actual-server:latest
    container_name: actualbudget
    restart: unless-stopped
    ports:
        - '8200:5006'
    volumes:
        - ./actual-data:/data"

Where are you hosting Actual?
Docker
What browsers are you seeing the problem on?
Firefox
Operating System
Linux

👋 Github issues is not a great spot for tech support. The community is quite active on Discord. Please reach out there.
Closing as this is not a bug report.


Update Apache included for CVE-2022-22720

Any chance to update the docker image here to solve  CVE-2022-22720 ?
Thanks :)

Hi,
In Release 1.0.7:

The application works using Flask Version 2.3.2
Apache is not installed on the container.

However I will update the container as soon as possible to:

Update the Flask Version 2.3.2 to 3.0.0
Update to next pythlon debian based release which resolve CVE-2023-45853 (not resolve yet)

Image updated today to fix python3-11 vulnerability


add release notes to redpanda version bump

There are no relevant tests and the tests that are triggered are expected to fail the linter. @redpanda-data/devprod please admin merge.


[Event Request] Codeunit 408 OnBeforeCheckDimValue

Please add a new publisher event to the function CheckDimValue as follows:
[External] CheckDimValue(DimCode : Code[20];DimValCode : Code[20]) Result : Boolean
//>> Start New Publisher Call
OnBeforeCheckDimValue(DimCode, DimValCode, Result, IsHandled);
IF IsHandled THEN
  EXIT;
//<< End New Publisher Call

IF (DimCode <> '') AND (DimValCode <> '') THEN
IF DimVal.GET(DimCode,DimValCode) THEN BEGIN
  IF DimVal.Blocked THEN BEGIN
.
.

New Publisher Event:
LOCAL [IntegrationEvent] OnBeforeCheckDimValue(DimCode : Code[20];DimValCode : Code[20];Result : Boolean;IsHandled : Boolean)

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.


Exit the process gracefully

It's to used to detect memory leak upon exiting the process.
Every thread in StorageEngine is already check the existed state.
If the existed state is set to be true, the thread will be exited.
But the the thread and the class in StarRocks is not seperated very well.
So the pull request do the best effort to the graceful exiting.

run starrocks_be_unittest

run starrocks_be_unittest


When partial is replaced with object w/o composition, default one gets lost

moved from https://github.com/StarcounterPrefabs/launcher-include/issues/18
Use case:

create starcounter-include that loads a partial with default composition, but without imperative one (one given in partial JSON)
attach to .partial (via attribute or property) a different object also w/o .LauncherLayoutInfo.Composition$

The defaultComposition get's replaced with undefined
That results in behavior like https://github.com/StarcounterPrefabs/Launcher/issues/242
It happens because at step 1. the DocumentFragment with defaultComposition gets attached to DOM, so it becomes empty

moved from https://github.com/StarcounterPrefabs/launcher-include/issues/18

I'll make a clone on each stamp, and keep the (merged) default composition as the reference to be able to reset it at any time.
Later on we could cache those on HTML Import level, not to build, and store it per instance

https://github.com/StarcounterPrefabs/launcher-include/issues/18 was closed


use NickCondron fsst changes

To run benchmarks for https://github.com/spiraldb/fsst/pull/45

The results are within margin of error. Not sure small difference in decompression will show up here.


fourier_3d code question

Hi,
I'm looking at the fourier_3d code and I can see the expanding dimension of train_a and test_a using reshape function.
Why expand the dimension of those data?
And most recently updated code, I can't see this expanding part.
Doesn't it matter?

Hi, I think it is useful to expand the size of a_train and a_test because in the forward method of the FNO3d class, the uniform grid is calculated and attached as features together with the evaluations of a. So expanding the dimensions becomes convenient so you can do torch.cat. Attaching the grid together with a as input should also be convenient to achieve better performance (I think). The same process is also done in fourier_2d and perhaps there are fewer dimensions there and it is easy to see what is happening.


Update database.json

Despite CI saying that the formatting is wrong, when I run eslint locally I get the opposite:
➜  deno_website2 git:(master) yarn lint
yarn run v1.22.4
$ eslint --ext .js,.jsx,.ts,.tsx util/ pages/ components/
Done in 3.55s.
➜  deno_website2 git:(master) gst
On branch master
Your branch is up to date with 'origin/master'.

nothing to commit, working tree clean
➜  deno_website2 git:(master)


[NDM]

What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
(Fixes: #ISSUE-ID)
How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

cc @PHILO-HE @zhztheplayer Seems work well

@ulysses-you, great! Thanks for your work!


Flush statistics based on events size

flush stats by size
document stats.flush_interval and flush_size

Fix #4346

Thanks for the update!

Thanks for the review!


Keep real size in Resizables

Their container will have to provide it i think

Keeping real size in there would invalidate Size::Auto and Size::Fill etc.


HTMLTableElement tFoot/tHead missing setter

HTMLTableElement's tFoot and tHead properties only have getters at the moment. This causes failures in the-table-element/tFoot.html and the-table-element/tHead.html.

Holy moly, sorry @Zirro, apparently I replaced you as the author of the issue by attaching a PR. Seems like Github's changed how this worked 😞
Anyways, this should fix it.

Holy moly, sorry @Zirro, apparently I replaced you as the author of the issue by attaching a PR.

No worries. Thanks for putting together this comprehensive fix :-)


Issues with Jetway

Heya! Im having issues with the jetways --
When I spawn in to start the flight, I start up GSX Couatl (As I don't have it auto starting), when Fenix2GSX recognises its started, it repositions the aircraft then calls the jetway, then I go through the regular service flow.
I import the flightplan in the EFB and catering and fuel truck comes and goes as per normal, after the 90s boarding is automatically requested by Fenix2GSX. At this point the jetway moves away from the aircraft (the rear staircase remains) and one of two things happen, either passengers start walking on air from the end of the jetway to the door of the aircraft or no passengers come at all and the aircraft is stuck with 10 PAX (I then have to set the "Load PAX" manually in the MCDU to fill the remaining passengers).
Similar thing happens when deboarding, I get to the gate, the jetway attaches, when deboarding starts the jetway detaches and passengers all walk on air to the gate.
I haven't encountered this situation when parking on a ramp where only stairs attach to the aircraft, it will remain attached throughout the deboarding cycle and passengers make it down the stairs into the bus just fine. It only seems to be at gates with a jetway.

Also try to disable GSX Audio-Control.
If it still persists enable debugJetways in the .config File and send me Log of a Session where it happened.
Since File-Name of the Log seems strange, it could also be an Issue how you start Fenix2GSX (and under which User you do that)

Apologies --
Disabling "Estimate passengers number" inside of GSX settings fixed the issue for me.


Unexpected failing install (Travis CI)

I'm trying to setup continuous integration for a .NET core project using Travis CI on GitHub.
This is my .travis.yml:
language: csharp
mono: none
script:
  - wget -q https://packages.microsoft.com/config/ubuntu/14.04/packages-microsoft-prod.deb
  - sudo dpkg -i packages-microsoft-prod.deb
  - sudo apt-get install apt-transport-https
  - sudo apt-get update
  - sudo apt-get install dotnet-sdk-2.2
  - sudo dotnet restore
  - sudo dotnet build ./Ion/
  - sudo dotnet build ./Ion.Tests/
  - sudo dotnet test ./Ion.Tests/

However, I receive the following output:
...
Unpacking dotnet-sdk-2.2 (2.2.203-1) ...
Processing triggers for man-db (<IP_ADDRESS>-1ubuntu1) ...
Errors were encountered while processing:
 /var/cache/apt/archives/aspnetcore-runtime-2.2_2.2.4-1_amd64.deb
E: Sub-process /usr/bin/dpkg returned an error code (1)
The command "sudo apt-get install dotnet-sdk-2.2" exited with 100.

Any ideas? Interestingly, $ dotnet run/restore/build/test still works, it just messes up my build because it returns non-zero code.

Are you able to reproduce it outside of Travis CI? On image which replicates its setup?
@dagood does it look familiar?

This seems to be a duplicate of https://github.com/dotnet/core/issues/2381, where dpkg is out of date and has a bug that causes this.
Note that Ubuntu 14.04 is now EOL!

Duplicate of #2381


libidn2: 2.1.1 -> 2.1.1a

Semi-automatic update generated by https://github.com/ryantm/nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/libidn2/versions.
meta.description for libidn2 is: '"Free software implementation of IDNA2008 and TR46"'.

Checks done (click to expand)

built on NixOS
/nix/store/jiazvaabbvczsv01yk03bl4xdz9rw82d-libidn2-2.1.1a-bin/bin/idn2 passed the binary check.
1 of 1 passed binary check by having a zero exit code.
0 of 1 passed binary check by having the new version present in output.
found 2.1.1a with grep in /nix/store/jiazvaabbvczsv01yk03bl4xdz9rw82d-libidn2-2.1.1a-bin
directory tree listing: https://gist.github.com/69186836cfd04c9ed1fea9fcfe167efa
du listing: https://gist.github.com/8201d2711f47d1cfc1bf7fa6b03c3ff8

Rebuild report (if merged into master) (click to expand)

19584 total rebuild path(s)
7335 package rebuild(s)
7329 x86_64-linux rebuild(s)
6409 i686-linux rebuild(s)
31 x86_64-darwin rebuild(s)
5815 aarch64-linux rebuild(s)
First fifty rebuilds by attrpath
AgdaSheaves
AgdaStdlib
DisnixWebService
EmptyEpsilon
MMA
R
SDL
SDL2
SDL2_gfx
SDL2_image
SDL2_mixer
SDL2_net
SDL2_ttf
SDL_gfx
SDL_image
SDL_mixer
SDL_net
SDL_sound
SDL_stretch
SDL_ttf
TotalParserCombinators
_20kly
_90secondportraits
a2jmidid
aacskeys
abcde
abcl
abiword
abootimg
accountsservice
acgtk
acoustidFingerprinter
acpilight
acsccid
adapta-gtk-theme
adlplug
adobe-reader
adom
adoptopenjdk-bin
adoptopenjdk-hotspot-bin-11
adoptopenjdk-jre-bin
adoptopenjdk-jre-hotspot-bin-11
adoptopenjdk-jre-openj9-bin-11
adoptopenjdk-openj9-bin-11
adwaita-qt
aegisub
aeolus
aesop
afew
afterstep

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/jiazvaabbvczsv01yk03bl4xdz9rw82d-libidn2-2.1.1a-bin \
  --option binary-caches 'https://cache.nixos.org/ https://r-ryantm.cachix.org/' \
  --option trusted-public-keys '
  r-ryantm.cachix.org-1:gkUbLkouDAyvBdpBX0JOdIiD2/DP1ldF3Z3Y6Gqcc4c=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(r-ryantm's Cachix cache is only trusted for this store-path realization.)
Or, build yourself:
nix-build -A libidn2 https://github.com/r-ryantm/nixpkgs/archive/bee129cd55dd463f06c8fd1403f1cd9050b940c3.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/jiazvaabbvczsv01yk03bl4xdz9rw82d-libidn2-2.1.1a-bin
ls -la /nix/store/jiazvaabbvczsv01yk03bl4xdz9rw82d-libidn2-2.1.1a-bin/bin

cc @fpletz for testing.

2.1.1a is not a functional change vs. 2.1.1, it only solves a missing documentation issue:
https://gitlab.com/libidn/libidn2/issues/65


path property required even when the action is :disable

    ----------------------------------
    path is a required property

    Resource Declaration:
    ---------------------
    # In /var/chef/cache/cookbooks/piazza_app/recipes/logs.rb

     32: logrotate_app 'petty_gc' do
     33:   action :disable
     34: end
     35:

I have a resource declaration to remove an old log rotation. It does not have a path, since it only needs to remove a chef log rotation by Chef name (I assume?). I don't know if this is something you want to fix or not, but I thought i would flag it.
It may be an artifact of Chef 16+ where required properties are actually required, now :)

PR coming shortly that fixes this.

thanks much!


Fix clippy rule

Signed-off-by: Alex Co<EMAIL_ADDRESS>
Summary

Ticket:
What's Changed

Changed
Fix Clippy rule.

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: onimsha
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


How do I run tests?

Hi, I want to contribute to this project but don't know how to run the whole testsuite. I can't find nothing in CONTRIBUTING.md or README.md. Any help?

@kostovakd, please take a look to the guide:
http://qaprosoft.github.io/carina


Updates to chat log

:tada: This PR is included in version 1.2.5 :tada:
Your semantic-release bot :package::rocket:


Introduce controller-runtime manager in gardenlet

How to categorize this PR?

/area dev-productivity scalability
/kind enhancement
What this PR does / why we need it:
Introduce controller-runtime manager in gardenlet.
No controllers have been refactored yet.
Which issue(s) this PR fixes:
Part of https://github.com/gardener/gardener/issues/4251
Special notes for your reviewer:
Similar to #6333.
Release note:

`gardenlet`s component configuration API has been changed in the following breaking ways:
- `.server.http` has been split into `server.{healthProbes,metrics}` (health endpoints and metrics are now served on different ports)
- `.server.https` has been removed

`gardenlet` serves health endpoints and metrics on different ports now. Adapt your scrape configs accordingly to port `metrics`.

/assign @oliver-goetz


brew test git-stree fails with git-stree 0.4.5

I've submitted a PR to update the Homebrew formula from 0.4.0 to 0.4.5 (Homebrew/homebrew#39992), but the build is breaking because brew test git-stree no longer works.
Here's the log for the failed build. Any idea what's going wrong?

Hey Josh,
Sorry about this; there was actually a bug introduced in my latest code for add. I fixed it and force-pushed the tag (yes, I know… Couldn't bring myself to releasing a fresh 0.4.6 with yet again the full details).
Can you retry?
Also, we need to get in touch on streamlining the Homebrew part; I'm not familiar with how this works, but I'd love to get involved and be able to take care of / automate Homebrew updates when this repo creates releases.

No problem, just pushed again and it seems to be working.
You likely could automate the process, as the only changes required are updating the url and sha256 stanzas, which should be easy enough to script.


'Cannot get annotation information' - Error

Hi,
I have used excerptor before when I tried it to make sure that I had installed it correctly, and it worked fine. Now however I am seeing the error message mentioned above. Could you help me out?
Thank you!

What did you do during this period? System update? What's current system version?
Which app do you use? Skim or Preview?

I am using Skim, and using version 10.11. I don't think I update the version afterwards, at least I know I did the installation procedure as described here https://github.com/guoc/excerptor/wiki/SIMBL-Installation-for-OS-X-10.11

Is the PDF file is copiable?

Yes, I can copy text from the pdf file.

 Now I have no clue to fix it.
When did you install Excerptor? 10.10 or 10.11?

Other PDF files behave similarly. I will try to restart the computer, reinstall SIMBL and excerptor. If successful, I will update the thread. Thank you anyway!

The issue may be caused by System Integrity Protection (SIP) introduced in 10.11
If you installed Excerptor on 10.10, please check https://github.com/guoc/excerptor#update-os-x

I'm having the same issue. Installed it, including SIMBL, on 11.11.

I am rewriting the code with Swift 2.1, and I will test it on a brand new OS X. Hope I can complete these things in one week.

I just updated Excerptor and wiki.
Have you done the steps in https://github.com/guoc/excerptor/wiki/SIMBL-Installation-for-OS-X-10.11 ?
This is required for OS X 10.11


WARNING: [facebook] unable to extract uploader; ERROR: [facebook]<PHONE_NUMBER>17569: No video formats found!;

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm reporting that yt-dlp is broken on a supported site
[X] I've verified that I have updated yt-dlp to nightly or master (update instructions)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[X] I've read about sharing account credentials and I'm willing to share it if required

Region
Australia
Provide a description that is worded well enough to be understood
Self explanatory, but never seen this type of message before.
Try #1

yt-dlp -F https://www.facebook.com/cakemoe/videos/495007896517569
[facebook] Extracting URL: https://www.facebook.com/cakemoe/videos/495007896517569
[facebook]<PHONE_NUMBER>17569: Downloading webpage
WARNING: [facebook] unable to extract uploader; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
ERROR: [facebook]<PHONE_NUMBER>17569: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U

Try #2

yt-dlp -F https://www.facebook.com/watch/?v=495007896517569
[facebook] Extracting URL: https://www.facebook.com/watch/?v=495007896517569
[facebook]<PHONE_NUMBER>17569: Downloading webpage
ERROR: [facebook]<PHONE_NUMBER>17569: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U

Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[X] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
>yt-dlp -vU https://www.facebook.com/cakemoe/videos/495007896517569
[debug] Command-line config: ['-vU', 'https://www.facebook.com/cakemoe/videos/495007896517569']
[debug] Encodings: locale cp1252, fs utf-8, pref cp1252, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version<EMAIL_ADDRESS>from yt-dlp/yt-dlp-nightly-builds [39e6c4cb4] (win_exe)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-10-10.0.22000-SP0 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] exe versions: ffmpeg 4.4.1-essentials_build-www.gyan.dev (setts), ffprobe 4.4.1-essentials_build-www.gyan.dev
[debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.07.04, curl_cffi-0.5.10, mutagen-1.47.0, requests-2.32.3, sqlite3-3.35.5, urllib3-2.2.2, websockets-12.0
[debug] Proxy map: {}
[debug] Request Handlers: urllib, requests, websockets, curl_cffi
[debug] Loaded 1829 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp-nightly-builds/releases/latest
Latest version<EMAIL_ADDRESS>from yt-dlp/yt-dlp-nightly-builds
yt-dlp is up to date<EMAIL_ADDRESS>from yt-dlp/yt-dlp-nightly-builds)
[facebook] Extracting URL: https://www.facebook.com/cakemoe/videos/495007896517569
[facebook]<PHONE_NUMBER>17569: Downloading webpage
WARNING: [facebook] unable to extract uploader; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
ERROR: [facebook]<PHONE_NUMBER>17569: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
Traceback (most recent call last):
  File "yt_dlp\YoutubeDL.py", line 1622, in wrapper
  File "yt_dlp\YoutubeDL.py", line 1778, in __extract_info
  File "yt_dlp\YoutubeDL.py", line 1837, in process_ie_result
  File "yt_dlp\YoutubeDL.py", line 2843, in process_video_result
  File "yt_dlp\YoutubeDL.py", line 1119, in raise_no_formats
yt_dlp.utils.ExtractorError: [facebook]<PHONE_NUMBER>17569: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U

Both links give me this in browser:

This Video Isn't Available Anymore
The link may be broken or the video may have been removed. You can explore more videos or try logging into facebook.com and then visiting the link again.

Are you sure about this:

[x] I've checked that all provided URLs are playable in a browser with the same IP and same login details

I'm having this problem a lot. Not private video. Fails randomly, failures are more frequent than successes.

@Rikk share a verbose log

Both links give me this in browser:

This Video Isn't Available Anymore
The link may be broken or the video may have been removed. You can explore more videos or try logging into facebook.com and then visiting the link again.

Are you sure about this:

[x]  I've checked that all provided URLs are playable in a browser with the same IP and same login details

Definitely the link is playable in the Browser, I just checked 22/Jul/2024.
There is no reason you cannot see it, unless the video is geo-location blocked?
Here is the link again.
https://www.facebook.com/watch/?v=495007896517569

Definitely the link is playable in the Browser, I just checked 22/Jul/2024.

But is it playable in browser when you're not logged in? In a private/incognito window? You're not passing any cookies to yt-dlp

Definitely the link is playable in the Browser, I just checked 22/Jul/2024.

But is it playable in browser when you're not logged in? In a private/incognito window? You're not passing any cookies to yt-dlp

OMG! 😮It never occurred to me I had to pass the cookies to yt-dlp, as I never had to do so in FB before. My bad.
yt-dlp --cookies-from-browser chrome -F https://www.facebook.com/watch/?v=495007896517569
[facebook] Extracting URL: https://www.facebook.com/watch/?v=495007896517569
[facebook]<PHONE_NUMBER>17569: Downloading webpage
Extracting cookies from chrome
ERROR: Could not copy Chrome cookie database. See  https://github.com/yt-dlp/yt-dlp/issues/7271  for more info
ERROR: Could not copy Chrome cookie database. See  https://github.com/yt-dlp/yt-dlp/issues/7271  for more info

After reading the issue above, I closed all Chrome windows, and voila, the cookies database is no longer locked, and I could download the video! Thanks again.

@bashonly
In my theory, it could be a site bug (or some kind of rate limit), as it happens more often for videos located in some profiles, while in others it doesn't happen, apparently. For the same video, sometimes the problem doesn't manifest at all; while for videos in different profiles, success rate can be very low.

@Rikk share a verbose log

Failure:
[debug] Command-line config: ['--list-formats', '-v', '--', 'https://www.facebook.com/tauan.amorim.1/videos/1809556876049234/']
[debug] Encodings: locale cp1252, fs utf-8, pref cp1252, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version<EMAIL_ADDRESS>from yt-dlp/yt-dlp [89a161e8c] (win_exe)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-10-10.0.19044-SP0 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] exe versions: none
[debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.07.04, curl_cffi-0.5.10, mutagen-1.47.0, requests-2.32.3, sqlite3-3.35.5, urllib3-2.2.2, websockets-12.0
[debug] Proxy map: {}
[debug] Request Handlers: urllib, requests, websockets, curl_cffi
[debug] Loaded 1829 extractors
[facebook] Extracting URL: https://www.facebook.com/tauan.amorim.1/videos/1809556876049234/
[facebook]<PHONE_NUMBER>049234: Downloading webpage
ERROR: [facebook]<PHONE_NUMBER>049234: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
Traceback (most recent call last):
  File "yt_dlp\YoutubeDL.py", line 1626, in wrapper
  File "yt_dlp\YoutubeDL.py", line 1782, in __extract_info
  File "yt_dlp\YoutubeDL.py", line 1841, in process_ie_result
  File "yt_dlp\YoutubeDL.py", line 2847, in process_video_result
  File "yt_dlp\YoutubeDL.py", line 1123, in raise_no_formats
yt_dlp.utils.ExtractorError: [facebook]<PHONE_NUMBER>049234: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U

Success:
[debug] Command-line config: ['--list-formats', '-v', '--', 'https://www.facebook.com/tauan.amorim.1/videos/1809556876049234/']
[debug] Encodings: locale cp1252, fs utf-8, pref cp1252, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version<EMAIL_ADDRESS>from yt-dlp/yt-dlp [89a161e8c] (win_exe)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-10-10.0.19044-SP0 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] exe versions: none
[debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.07.04, curl_cffi-0.5.10, mutagen-1.47.0, requests-2.32.3, sqlite3-3.35.5, urllib3-2.2.2, websockets-12.0
[debug] Proxy map: {}
[debug] Request Handlers: urllib, requests, websockets, curl_cffi
[debug] Loaded 1829 extractors
[facebook] Extracting URL: https://www.facebook.com/tauan.amorim.1/videos/1809556876049234/
[facebook]<PHONE_NUMBER>049234: Downloading webpage
[debug] Formats sorted by: hasvid, ie_pref, lang, quality, res, fps, hdr:12(7), vcodec:vp9.2(10), channels, acodec, size, br, asr, proto, vext, aext, hasaud, source, id
[info] Available formats for<PHONE_NUMBER>049234:
ID                EXT RESOLUTION ¦   FILESIZE   TBR PROTO ¦ VCODEC        VBR ACODEC     ABR ASR MORE INFO
---------------------------------------------------------------------------------------------------------------------
1826790661010186a m4a audio only ¦ ~231.41KiB   66k https ¦ audio only        mp4a.40.5  66k 44k DASH audio, m4a_dash
sd                mp4 unknown    ¦                  https ¦ unknown           unknown
hd                mp4 unknown    ¦                  https ¦ unknown           unknown
964095082019228v  mp4 360x640    ¦ ~954.27KiB  271k https ¦ avc1.4d001e  271k video only         DASH video, mp4_dash
971446191025227v  mp4 540x960    ¦ ~  1.90MiB  551k https ¦ avc1.64001f  551k video only         DASH video, mp4_dash
1133736587958726v mp4 720x1280   ¦ ~  3.95MiB 1147k https ¦ avc1.64001f 1147k video only         DASH video, mp4_dash

@Rikk yep that looks like a legit bug. could you open a new issue please? I think I have a solution for it but it would be good to have proper issue tracking.

@bashonly https://github.com/yt-dlp/yt-dlp/issues/10532

Greetings, I have noticed the same problem. Even after updating it has the same error, and the video is still available to watch on FB.
`C:_______>yt-dlp.exe https://www.facebook.com/tadeodaniel.moracruz/videos/2971407446334915
[facebook] Extracting URL: https://www.facebook.com/tadeodaniel.moracruz/videos/2971407446334915
[facebook]<PHONE_NUMBER>334915: Downloading webpage
WARNING: [facebook] unable to extract uploader; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
ERROR: [facebook]<PHONE_NUMBER>334915: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
C:_______>yt-dlp.exe -U
Current version<EMAIL_ADDRESS>from yt-dlp/yt-dlp
Latest version<EMAIL_ADDRESS>from yt-dlp/yt-dlp
Current Build Hash: 468a6f8bf1d156ad173e000a40f696d4fbd69c5aa7360229329b9063a388e7d0
Updating to<EMAIL_ADDRESS>from yt-dlp/yt-dlp ...
Updated yt-dlp to<EMAIL_ADDRESS>from yt-dlp/yt-dlp
C:_______>yt-dlp.exe https://www.facebook.com/tadeodaniel.moracruz/videos/2971407446334915
[facebook] Extracting URL: https://www.facebook.com/tadeodaniel.moracruz/videos/2971407446334915
[facebook]<PHONE_NUMBER>334915: Downloading webpage
WARNING: [facebook] unable to extract uploader; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
ERROR: [facebook]<PHONE_NUMBER>334915: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
C:_______>yt-dlp.exe "https://www.facebook.com/tadeodaniel.moracruz/videos/2971407446334915"
[facebook] Extracting URL: https://www.facebook.com/tadeodaniel.moracruz/videos/2971407446334915
[facebook]<PHONE_NUMBER>334915: Downloading webpage
WARNING: [facebook] unable to extract uploader; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
ERROR: [facebook]<PHONE_NUMBER>334915: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
`
Thank you, Shalom.

@life777eternal I think it is because the video is age-restricted, therefore you probably need browser cookies to download it.

@life777eternal can you open a new issue for that please? we should try to detect if the video is age-restricted and raise an appropriate error


FR: Remove non exist local file.

Hi,
I found the file removed locally is NOT removed in remote.
Steps to reproduce.

Create a file in local.
Run glynn command to sync.
Remove the file which is created in step 1.
Run glynn command to sync.

Expected:
Removed the file.
Actual:
Glynn never remove the file.
Can we have a option to remove the file which is not exist on local?

Yes, this is a known behavior.
Feel free to open a pull request if you wish to change it.

A short hack could be deleting all the remote tree, then re-uploading the necessary files/dirs :question:

This is not a good solution. If you have large files or a big number of them, it means your app would send 404s for some quite time. We should loop through all distant files and remove them if they're not used locally anymore.

Since we need to download all files from server to verify which are differen,. I'm thinking about create a PR to solve that problem and adopt the follow strategy:

Create some file, something like _hashes, and store md5 or sha1 of each file inside that. If this file don't exists, we create that, store hashes and upload everything to server (including this file).
Everytime glynn runs, download that file and verify which hashes exists, calculate the hash of each file to upload and don't upload files with same hash. Update _hashes file and upload it also.

This still don't automatically deleting files from server, but, at least solves the problem that each file is uploaded everytime.

@ricardovsilva I like your idea. A PR would be most welcome.
Deleting non-existant files is not really the same issue though. But solving it should actually be easier. Loop through all files on the server, and check if the same file exists locally. If it doesn't, delete it.

Comming back at this. Now I'm working with Grunt with ftpush. Some people prefer Gulp. At all, for me glynn makes no sense anymore.

Thanks all!


Search and Discovery - The search page is passing the wrong parameters when the Type and Organization filters are passed.

Currently when a user selects the Type filter is passes in the URL parameter of types it needs to be "type". Additionally when they select organization it needs to send in "agency" not organization.  This is in the temp-master but I believe the same issue will happen in develop.

Verified that the correct parameters are being passed for the filters now.


Unable to swagger-gen rc48 spec due to String model overloading

Using the deprecated rc48 POD spec and Swagger v1.5.16
Swagger generation returns errors on String model being overridden within the spec itself.
[ERROR] ..../symphony-java-api/pod/target/generated-sources/swagger/src/main/java/org/symphonyoss/symphony/pod/model/CompanyCertInfo.java:[200,17] toString() in org.symphonyoss.symphony.pod.model.CompanyCertInfo cannot override toString() in java.lang.Object
return type org.symphonyoss.symphony.pod.model.String is not compatible with java.lang.String
In spec:
String:
type: string

That doesn't cause any errors for me.
When exactly do you get that error?

We are using swagger 1.5.6 and cogen 2.2.2 as part of project symphony-java-api.
Yes, codegen is generating org.symphonyoss.symphony.pod.model.String, which is core to this issue.


Set sidenoderHome to userData, instead of user's home

Hello,
Currently sidenoder stores it's data in the user's home, this make it cluttered and may clash with other applications.
A cleaner approach would be to use Electron's app.getPath('userData') that uses each supported OSes specific per-application data directory
Relevant code:
https://github.com/vKolerts/quest-sidenoder/blob/2d84b1339ada40b48117ed55d58fa75714ac0860/main.js#L22
To not break sidenoder for current users, it could first check if the sidenoder directory exists in user's home, and use that if it is the case. Something along the lines of:
global.sidenoderHome = path.join(global.homedir, 'sidenoder').replace(/\\/g, '/');
if (!fs.existsSync(global.sidenoderHome))
	global.sidenoderHome = app.getPath('userData')

To Reproduce
Steps to reproduce the behavior:

Open sidenoder
sidenoder data directory is created at user home

Expected behavior
Sidenoder creates it's data directory in each supported OSes specific per-application data directory
Desktop:

OS: Tested on Windows and Linux (ArchLinux)
Binary: .exe and .appimage
Version: 0.7.3

Thanks, I will think about this. Maybe will make it optional for customize path of home dir


makeCqData is not able to include new values to an existing sample

This is a problem if more than one input.cq contain values for an sample (same experiment).
Fix: combine them prior data analysis in the .csv tables.
Should be easy to add in future releases.

On second thought, this is not a problem. We can combine subsampes:

100.1
100.2
100.3

can be combined into "100" and therefore it is possible to add data to the same sample. But it is needed to change the sample names in raw data accordingly.

This is not a perfect solution. But the workflow is in this way consistent. If another form of input is needed, one can easily adapt the function for their purpose.
Therefore closing this issue.