Region status?

Hi, I was wondering what the status of region was - it looked like AZP was still being debugged?
Is the plan to release region by 2018-12-31 along with PySAL?
Is there anything small that people could help with?

Hey, it's not going to make the december 2018 release of PySAL 2.0. It will continue to be released as an independent package (available using pip install region), and should see some attention due to some new incoming grants.
Thanks for your interest; it's really useful to have these kinds of comments :smile:

Okay great - it would be a really nice complement to sklearn's algorithms. I'm attempting to use clustering with census and other data and OpenStreetMap roads to define neighborhood/subdivision boundaries. Thanks for your work on it - I'd be happy to contribute where I'm able!

you may also be interested in osnap a package we're working on for use cases exactly like what you describe. It's still in pretty early alpha stage, but it wraps scikit and region in ways specifically designed for neighborhood analysis
we'll happily accept contributions in any form :)


Dependency Tracking

Goal
Enable sharing of one asset that includes references to other assets.
Motivation
Imagine an artist working remotely on sh050. He'll need access to files related to the project, but not all of them. And we can't just send the directory containing sh050, because sh050 depends on other assets from elsewhere, depending on the artist role.

The animator require rigs and props, but no models or render-resolution textures.
The shader requires models or caches, along with textures. But no rigs or rendered image sequences.
The compositor requires rendered image sequences, but no models or rigs.

Implementation
Tracking of dependencies is a well versed subject of research and application. There are lots and lots of implementations of it out there in the wild.

pip
rez
conda
apt-get
yum
nix

To name just a few.
Each of them tackle the same issue, in slightly different ways and for slightly different purposes. The purpose of their individual existence is I think best illustrated by this simple fact: we can't use any of them.
The reason we can't use them is because because they do both (1) dependency resolution and (2) downloading of data and the data we need isn't what they offer.
The dependency resolution aspect, though different across each of them, are conceptually sound and what I'm thinking is we pick one of these and re-implement the dependency resolution into our own dependency tracking mechanism.
pip
Pip operates on perhaps the most simple of rules. Given a library, it looks at what the library depends on.
MyApp
Framework==0.9.4
Library>=0.2

It then downloads these dependencies and looks at what dependencies the dependencies has.
MyDependency
OtherFramework==0.1.2
OtherLibrary>=0.0.4

So on and so forth, recursively pulling dependencies until there is no dependency left.
The other alternative is the likes of Rez, which not only looks downstream for dependencies, but upstream as well to determine whether a child-dependency conflicts with some other dependency.
Something along the lines of pip could suffice for us.
MyAsset
OtherAsset=v023
OtherAsset2=v102

Just adding a note, theoretically an asset could rely on two different versions of the same asset. (Having them both linked)
Also, I believe the published versions are totally encapsulated and as such the two should never conflict ever. As such dependency conflict should (theoretically) not happen.

That's a good point.


bam2fastx conda package has pbindex that isn't compatible with latest data

Operating system
Unix
Package name
bam2fastx
Describe the bug
In order to run bam2fasta or bam2fastq a .pbi index file is required. The conda package installs pbindex as part of pbbam, version 1.0.6 but this does not work on the most recent bam files because the read group ID (@RG ID:) in the header is not the same as the read group ID given in each read line (RG:Z:) where it is appended by /xx--xx where xx is a number
I tried an environment containing both bam2fastx 1.3.0 and pbbam 1.6.0 which solves the pbindex problem but then libpbbam is not usable by bam2fasta or bam2fastq. So I need two environments to do one essential job.
I also noticed that if you try to install more tools in the same environment such as blasr or lima, there are incompatbilities between the conda packages that make it impossible.

See issue https://github.com/PacificBiosciences/pbbioconda/issues/321 for bam2fastx issue

Should be fixed with bam2fastx-1.3.1. Please re-open if not.

Should be fixed with bam2fastx-1.3.1. Please re-open if not.


Scbless

See test-scbless.R for examples. I went with making scbless and sc_declare_current both name the same function, because I think each may be more intuitive for a different set of people.

Nice work!

I tried out scbless on my current pipeline  for water temperature predictions in DRB, and it works great!
I made target_A dirty, which would trigger a rebuild of target_A and target_B. I used scbless('target_A'), which made target_A current and did not trigger a rebuild of either target_A or target_B because target_B was no longer dirty by descent.


chore: remove removed contributors/tools path

Checklist:

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the main branch of freeCodeCamp.
[x] I have tested these changes either locally on my machine, or GitPod.

Just some left-over stuffs.

Thanks @ShaunSHamilton :+1:


support rabbitmq plugin

Please answer these questions before submitting pull request

Why submit this pull request?

[ ] Bug fix

[x] New feature provided

[ ] Improve performance

Related issues

Bug fix

Bug description.

How to fix?

New feature or improvement

Describe the details and related test reports.

2 requirements

Provide automatical test cases. Do you know where are they?
Send pr to master, after this merge. To avoid my cherry pick override your contributions.

yeah. i am writing  test cases  by now.
en, but i am forked  5.x repo,which should  merge 5.x  that it is no problem?

Thank you for your reminder. i try to do it.

@WithLin Auto tests are still failure. Are you going to fix this im these two days? Otherwise, I have to release GA without this

I will run the test again.

@ascrutae Is the source branch right?

@WithLin  I found that the rabbitMQ testcase scenario  has all failed, Here is the error log. I will move this PR  to the next version.

Also, I found out several conflicts, may be caused by undertow plugin merging.

emmm, i  also think that this PR  remove next  version. i will fix  the conflicts. @wu-sheng @ascrutae


Is there a way to only show the screen?

Like the hosted simulator of Omega, is there a way to toggle to the screen view? And preferably only the enlarged screen. Perhaps styled as  https://getomega.dev/ide/editor simulator view with foldable elements: screen, keyboard

I can have a look at this

This is so useful. I'll do it.


Remove unnecessary imports and add ToShared utility module

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 13 (0.0%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-11.0%) to 28.224%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/server.rs
0
5
0.0%

src/utils/shared.rs
0
8
0.0%

Totals

Change from base Build<PHONE_NUMBER>:
-11.0%

Covered Lines:
116

Relevant Lines:
411

💛  - Coveralls


Update Set-CASMailbox.md

Minor schema fix (missing space) for Type: value on a parameter.

OPS Build status updates of commit d4d77c2:
:clock10: Preparing: average preparing time is 1 min(s) 12 sec(s)

OPS Build status updates of commit d4d77c2:
:clock10: Incremental building: average incremental building time is 12 min(s) 22 sec(s)

OPS Build status updates of commit d4d77c2:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

exchange/exchange-ps/exchange/client-access/Set-CASMailbox.md
:white_check_mark:Succeeded
View (exchange-ps)

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Cycle the key again since the private key was missing needed headers

Would it be valuable to add documentation regarding how to create these keys or write a script that generates/formats these for new users?

Yes, already in progress :) I'll submit it once I know this works.


Failed at the "SPADES (Test_Sample)" step

Ran step 6 from Quick Start to test PHoeNIx on a test sample and failed at the "SPADES (Test_Sample)". The error message does not specify error (also see log.txt of terminal output, and nextflow.log attached):
[6b/f2ff4e] NOTE: Process PHOENIX:PHOENIX_EXTERNAL:SPADES_WF:SPADES (Test_Sample) terminated with an error exit status (1) -- Error is ignored
Ran on University of Florida supercomputer with the following commands:
$ module load nextflow/22.04.5
$ conda activate PHoeNIx
$ singularity version
3.8.6
$ PATH_TO_DB="/home/$PATH/DB/Minikraken2DB"
$ time nextflow run cdcgov/phoenix -r v1.0.0 -profile test,singularity -entry PHOENIX --kraken2db $PATH_TO_DB
Logs
log.txt
.nextflow.log
.spades.log_spades_outcome.csv
Relevant .command.err file
shows it couldn't reach the Test_Sample directory. I double checked this path and it does exist, so maybe there is an issue with the Singularity bind mount for Spades.
INFO:    Converting SIF file to temporary sandbox...
WARNING: underlay of /etc/localtime required more than 50 (73) bind mounts
cp: cannot create regular file '/blue/$PATH_B/tests/PHoeNIx/2022-10-24-14-50/results/Test_Sample/': No such file or directory
cp: cannot create regular file '/blue/$PATH_B/tests/PHoeNIx/2022-10-24-14-50/results/Test_Sample': No such file or directory
INFO:    Cleaning up image...
Relevant .command.log file
INFO:    Converting SIF file to temporary sandbox...
WARNING: underlay of /etc/localtime required more than 50 (73) bind mounts
Option -k triggered, argument = Test_Sample.trimd_summary.txt
Option -n triggered, argument = Test_Sample
Option -d triggered, argument = /blue/$PATH_B/tests/PHoeNIx/2022-10-24-14-50/results
cp: cannot create regular file '/blue/$PATH_B/tests/PHoeNIx/2022-10-24-14-50/results/Test_Sample/': No such file or directory
cp: cannot create regular file '/blue/$PATH_B/tests/PHoeNIx/2022-10-24-14-50/results/Test_Sample': No such file or directory
INFO:    Cleaning up image...
find: ‘*.spades.log’: No such file or directory

I ran into this issue as well. This is due to the process looking in the workdir for a "$workdir/blue/$PATH_B/tests/PHoeNIx/2022-10-24-14-50/results/Test_Sample/", which doesn't exist.

Issues was resolved with BRR offline. Changes that will be pushed in the v1.1.0 release should fix this issue. Problem also described in github issue https://github.com/CDCgov/phoenix/issues/82


CIV-TASK Re-instate civil-screenshots.zip in AAT

JIRA link (if applicable)
N/A
Change description
Re-instates the civil-screenshots.zip file for AAT functional test runs.
The file was temporarily disabled as it was being produced against the wrong directory. This should rectify the issue.
Does this PR introduce a breaking change? (check one with "x")
[ ] Yes
[x] No

This reintroduces the lines commented out here:
https://github.com/hmcts/civil-ccd-definition/pull/2541


Consider including MysIDC datasets

https://mysidc.statistics.gov.my/ includes many fairly well-formatted datasets not included in the OpenDOSM catalogue, e.g., I'm currently using state-level labour force stats and state-level GDP by activity from MysIDC. Please consider including these in the OpenDOSM catalogue,

Step-by-Step Guide to Integrating MyslDC Datasets

Step 1: Secure Access and Automated Download

API Key Management: Use environment variables to securely store API keys and credentials.

Automated Scripts: Write scripts in Python or another preferred language to automate data fetching. For example, using the requests library in Python to fetch data:
import os
import requests

API_KEY = os.getenv('MYSLDC_API_KEY')
url = 'https://api.mysldc.com/data'
headers = {'Authorization': f'Bearer {API_KEY}'}

response = requests.get(url, headers=headers)
if response.status_code == 200:
    data = response.json()
else:
    print('Failed to fetch data:', response.status_code)

Step 2: Data Handling - Validation and Transformation

Data Integrity Checks: Utilize checksum or hash functions to verify data integrity.

Schema Validation: Use JSON schema validation tools like jsonschema in Python to ensure the data conforms to expected structures.
from jsonschema import validate, ValidationError

schema = {
    "type": "object",
    "properties": {
        "id": {"type": "integer"},
        "name": {"type": "string"},
        # Add other properties here
    },
    "required": ["id", "name"]
}

try:
    validate(instance=data, schema=schema)
except ValidationError as e:
    print('Invalid data:', e.message)

Data Standardization: Standardize date and number formats for consistency, e.g., converting dates to ISO 8601 format.

Step 3: Normalization for Consistency

Data Cleaning: Utilize libraries like pandas to remove duplicates and handle missing values.
import pandas as pd

df = pd.DataFrame(data)
df.drop_duplicates(inplace=True)
df.fillna('Unknown', inplace=True)

Field Mapping: Map fields from MyslDC datasets to our application's data models, possibly using a configuration file for flexibility.

Step 4: Efficient Data Storage and Management

Schema Updates: Use SQL scripts or ORM migrations (e.g., SQLAlchemy, Django ORM) to update database schemas.
ALTER TABLE my_table ADD COLUMN new_field VARCHAR(255);

Batch Processing: Implement batch jobs using tools like Apache Airflow or Cron for scheduled data ingestion.

Step 5: Deriving Insights

Exploratory Data Analysis (EDA): Use tools like Jupyter notebooks and libraries like matplotlib and seaborn for visualizing data trends and patterns.
import matplotlib.pyplot as plt
import seaborn as sns

sns.histplot(df['some_column'])
plt.show()

Dashboard Updates: Integrate with business intelligence tools like Tableau or Power BI, or custom dashboards using frameworks like Dash or Bokeh.

Step 6: Documentation

Data Source Documentation: Create comprehensive documentation detailing data sources, structures, and transformations applied.
Code Documentation: Ensure all scripts and code are commented and documented using tools like Sphinx for Python or JSDoc for JavaScript.

Step 7: Testing and Validation

Unit Testing: Use testing frameworks like pytest in Python to write unit tests.
def test_data_validation():
    with pytest.raises(ValidationError):
        validate(instance=invalid_data, schema=schema)

Integration Testing: Develop end-to-end tests that simulate the complete data flow.

Performance Testing: Use tools like JMeter or Locust to ensure the system handles the new data load efficiently.

User Acceptance Testing (UAT): Gather feedback from end-users to ensure the integration meets their needs and improves their experience.

Step 8: Implementation Plan

Kick-off Meeting: Align all stakeholders on the project goals and processes.
Requirements Gathering: Identify specific data points and insights needed for the application.
Define Milestones & Deadlines: Set clear milestones with due dates to ensure timely progress.
Regular Updates: Schedule regular check-ins to address any issues and keep stakeholders informed.

By following this detailed approach, the MyslDC datasets are seamlessly integrated into application, providing valuable insights that enhance functionality and drive better decision-making.

This looks like ChatGPT generated content.
Furthermore, this project is no longer actively maintained - as we have migrated and integrated with datagovmy. See here.

This looks like ChatGPT generated content.
Furthermore, this project is no longer actively maintained - as we have migrated and integrated with datagovmy. See here.

https://github.com/VinciGit00/Scrapegraph-ai/pull/344
See my level dude...


add conjugacy for regression models with inprod and %*% for univariate priors

For testing only.
This finally adds the conjugacy detection for such common cases:
y[i] ~ dnorm(inprod(x[i,1:p],beta[1:p], 1)
beta[i] ~ dnorm(0,1)

y[i] ~ dnorm((X[i,1:p]%*%beta[1:p])[1,1], 1)
beta[i] ~ dnorm(0,1)

@danielturek no hurry at all, but at your convenience please review my extension of the "linear" conjugacy to handle these cases. In particular see how I handled the structureExpr and note that the offset and coeff I produce are NOT valid code, but since we don't use those to actually generate code, I think that is ok.  See the new tests in test-mcmc.R to see what cases  I am handling and what the result of ``cc_checkLinearity` is for these.
This addresss NCT issue 56.

@paciorek Overall, LGTM.  A few comments of varying importance:
Shall we remove the line:
if(exists('paciorek')) browser()

Are we concerned about also catching (identical) cases that are written as:
y[i] ~ dnorm(b0 + sum(beta[1:p] * X[i, 1:p]), 1)

Lines 1152 and 1153, something concerns me about using the nested list indexing with expr, namely expr[[2]][[1]] and similarly expr[[3]][[1]], without first checking that second level of list-indexing exists, and also the potential for the common R warning about "the condition has length > 1 and only the first element will be used", if it's the case that `expr[[2]][[1]] is itself an expression of some sort.
That said, I tried to come up with an example of this causing a problem and I couldn't so, I can't say for sure it's a problem.  I guess someone will tell us if it causes a problem ever, and we can fix it then.
Also, I see and I'm ok with the changes to how the results of cc_checkLinearity look in some cases, in particular, no longer being valid expressions.

Ok, in lines 1152-3, I added a check for length(expr[[2]]) and same for length(expr([[3]]), though it seems the only way to not have the current code be ok would be if we were multiplying inputs that are not indexed, which I don't think is possible.
Good catch on the sum(). I've added code to handle that case.

@paciorek I restarted failed test batch 5.

@paciorek I fixed a typo in the recent changes, changing len(...) into length(...).

@paciorek I cleaned up the new tests you added, the issue was that constants was being redefined randomly, so the samples didn't agree.  I also cleaned up extra definitions of inits.

@paciorek Tests passed, I've reviewed this, LGTM.
Thanks for this improvement to the conjugacy detection.


jsdom, DOM access

Are you requesting a feature or reporting a bug?
anyone, is a DOUBT
has a way to get the entire html markup?
I'm looking a way to use testcafe with jsdom, and not found anything in test controller :( (an docs, google, etc)

You can use
import { ClientFunction } from 'testcafe';

const getPageHTML = ClientFunction(() => document.documentElement.innerHTML);

test('Test', async t => {
    var html = await getPageHTML();
});

awesome!!
thank you so much  @AndreyBelym !!


Windows 8.1 Compatibility

Couldn't get npm install to work on an Windows 8.1 VM, due to:
Note, it was necessary to install python to get past a previous build error.

I guess I put my tips in the wrong repo. This is how I got the npm install to work.
https://github.com/TestArmada/testarmada.github.io/issues/2

@asunar thanks for these tips. Looks like we've got some paths to fix up

Windows 8.1
$ node --version
v4.2.1
$ npm --version
3.3.9
Issues and workarounds

npm install fails => install Python 2.7, npm install --msvs_version 2015 (see Compiling Native Addon Modules at https://github.com/Microsoft/nodejs-guidelines/blob/master/windows-environment.md#configuring-your-windows-development-environment)
npm install succeeds but following files listed in ./conf/nightwatch.json do not exist.

./node_modules/testarmada-magellan-nightwatch/node_modules/selenium-server/lib/runner/selenium-server-standalone-2.46.0.jar
./node_modules/testarmada-magellan-nightwatch/node_modules/chromedriver/lib/chromedriver/chromedriver.exe

Download and place the files listed above in the correct locations.
Run "./node_modules/.bin/magellan" --serial --browser=chrome (note the double quotes)

The tests should succeed (works on my machine).

Windows 8.1
$ node --version
v4.2.1
$ npm --version
3.3.9
After creating the missing phantomjs file in the correct location (as listed in the ./conf/nightwatch.json file and adding the .exe to the end of the path) ran
"./node_modules/.bin/magellan" --serial --browser=phantomjs
walmart test succeeds.
github test fails with the following error:
errorMessage":"Refused to evaluate a string as JavaScript because 'unsafe-eval' is not an allowed source of script in the following Content Security Policy directive: \"script-src assets-cdn.github.com\\


create a hadoop cluster

[x] namenode
[x] datanode
[x] resource manager
[x] node manager

close #1

[x] statefulset
[x] headless service
[ ] persistent volume, persistent volume claim


Download data is limited

Hi sir,
Your cloud services is paid and only 5 GB data is allowed to download for free. Is it possible to provide any other link like Google drive or Baidu pan? or any  other ways to download from the same link without limit restrictions?

I found that we can increase the limit by different ways like buying plan , download desktop app, verify phone number etc. for example only verify phone number provide 40 GB extra download. So we can use these ways to get all dataset. Thank you


Added Count Maximum Possible Subsequence in CPP

Have you read the Contributing Guidelines on Pull Requests?
YES.
Description
Given two words and a string.
By using two words , Count How many different subsequence's can be created through the string.
Two subsequence's are considered to be different if they start or end
at different positions in the string.
Checklist

[x] I've read the contribution guidelines.
[x] I've checked the issue list before deciding what to submit.
[x] I've edited the README.md and link to my code.

Related Issues or Pull Requests
Fixes #4459

@ankitaggarwal23 kindly review this also :D

Done.

Please make an issue here and raise a PR, for an article as part of our Docs repository: https://github.com/TesseractCoding/NeoAlgo-Docs
It would be much appreciated. Thanks!


What is the value of VM bit encoding for mask-register logical instructions?

Not only the instructions in chapter 16.1 but also 17.6 (vcompress.vm) did not support masking.
The spec. did not specify what the VM bit exactly is for those instructions.
Was it treated as Don't Care or Should be One/Zero?

Unmasked instructions are always VM=1, but the docs could perhaps explicitly say that like it does for a few others.  When an instruction doesn't support masking, VM=0 should be a reserved encoding.  The docs do say this for a few instructions.  This could probably be improved to be more consistent across all instructions that don't support masking.

@jim-wilson
Agree with you


#28 prevent default tab event on choosing an item using the tab key

PR for #28

@jbate Any reason this never got merged in?

@jbate  Any reason this never got merged in?


chore: Update .github/workflows/audit.yaml in `artichoke/strftime-r…

…uby`
Managed by Terraform.
Contents
---
name: Audit
"on":
  push:
    branches:
      - trunk
  pull_request:
    branches:
      - trunk
  schedule:
    - cron: "0 0 * * TUE"
jobs:
  ruby:
    name: Audit Ruby Dependencies
    runs-on: ubuntu-latest

    steps:
      - name: Checkout repository
        uses: actions/checkout@v3

      - name: Install Ruby toolchain
        uses: ruby/setup-ruby@v1
        with:
          ruby-version: ".ruby-version"
          bundler-cache: true

      - name: bundler-audit
        run: bundle exec bundle-audit check --update

  rust:
    name: Audit Rust Dependencies
    runs-on: ubuntu-latest
    strategy:
      matrix:
        checks:
          - advisories
          - bans licenses sources

    # Prevent sudden announcement of a new advisory from failing ci:
    continue-on-error: ${{ matrix.checks == 'advisories' }}

    steps:
      - name: Checkout repository
        uses: actions/checkout@v3

      - name: Install Rust toolchain
        run: |
          echo "::group::rustup toolchain install"
          rustup toolchain install stable --profile minimal
          echo "::endgroup::"
          echo "::group::set default toolchain"
          rustup default stable
          echo "::endgroup::"
          echo "::group::rustup version"
          rustup -Vv
          echo "::endgroup::"
          echo "::group::rustc version"
          rustc -Vv
          echo "::endgroup::"
          echo "::group::cargo version"
          cargo version --verbose
          echo "::endgroup::"

      - name: Generate Cargo.lock
        run: |
          if [[ ! -f "Cargo.lock" ]]; then
            cargo +stable generate-lockfile --verbose
          fi

      - uses: EmbarkStudios/cargo-deny-action@v1
        with:
          arguments: --locked --all-features
          command: check ${{ matrix.checks }}
          command-arguments: --show-stats

Audit Rust Dependencies (bans licenses sources) is now a required check for this codebase. It will run any time Cargo.toml changes. It may trigger in the case of dev dependencies.


Expose BaseModel to allow use of Sharded models.

We should expose the Base model of DynamoDB so that other projects can use Sharded Base Model for their purposes. This would improve the performance significantly.

Closing as resolved in PR #16 .


Change BMG 0x7eb for it to match the menu

Some Languages have not had their translation done, or I am not sure of how correct I have made them.
Solves #89

[x] E
[x] F
[x] G (Not verified)
[x] I (Not verified)
[ ] J
[ ] K
[ ] M
[x] Q
[ ] S
[x] U

Can you mention that you can change settings? Also you can keep everything in English because we are going to work with the Translation Project anyway.

Changes pushed!


Keep license period open

Small pull request to test the Contributors License Agreement (CLA) plugin on GitHub

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


getting error trying to build Privacy Preserving Search Applicatin

Having problems with a missing dependence.  Does the cmake file need to be updated?
library not found for -lhelib
Build target Privacy Preserving Search_2020-06-08T11-06-45.txt
Build target Privacy Preserving Search_2020-06-08T11-06-45.txt

HI, thanks for posting this issue.  In order to try and help pinpoint the problem, can you provide us with what step this was happening in the getting started?  was the script able to build the dependencies?

Thank you for the quick reply.
I did get some Cmake error, but I just went ahead and tried to start the project.   Attached are the Cmake.logs
It happened when I did step 7 on the Github instructions.
Thanks
JJS

On Jun 8, 2020, at 11:24 AM, Gregory Boland<EMAIL_ADDRESS><EMAIL_ADDRESS>wrote:
HI, thanks for posting this issue. In order to try and help pinpoint the problem, can you provide us with what step this was happening in the getting started? was the script able to build the dependencies?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/IBM/fhe-toolkit-macos/issues/11#issuecomment-640733175, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACCMJ22FX4OYFSSYND2IZNLRVUGDBANCNFSM4NYSAAXA.

So it looks like somewhere in the dependency build, it is failing.  It is not creating the HElib_macOS directory with the HElib library in it.  It would be quite helpful if we could see the logs from the dependency script when it runs.  That will be able to tell us where it is failing.  It will print out a mess of text on the terminal after running.  If you can look through that and tell us where it is failing, or perhaps copy it into a file and attach it, that would be best.  Sorry for the trouble, hope to get it working

All,
Attached is the original, complete console output for Step 5.
JJS

On Jun 8, 2020, at 12:59 PM, Gregory Boland<EMAIL_ADDRESS>wrote:
So it looks like somewhere in the dependency build, it is failing. It is not creating the HElib_macOS directory with the HElib library in it. It would be quite helpful if we could see the logs from the dependency script when it runs. That will be able to tell us where it is failing. It will print out a mess of text on the terminal after running. If you can look through that and tell us where it is failing, or perhaps copy it into a file and attach it, that would be best. Sorry for the trouble, hope to get it working
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/IBM/fhe-toolkit-macos/issues/11#issuecomment-640782813, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACCMJ2336UN6GPFF5V56WJDRVURJRANCNFSM4NYSAAXA.

@jjsenay i don't see anything attached, not sure it made it, unless i am missing something

Same problem. Relevant stdout log:
[...]
++ pwd
+ CURRENT_DIR=/Users/redacted/fhe-toolkit-macos/dependencies
+ DEPEND_DIR=/Users/redacted/fhe-toolkit-macos/dependencies
+ cp /Users/redacted/fhe-toolkit-macos/dependencies/Helib_install/CMakeLists.txt /Users/redacted/fhe-toolkit-macos/dependencies/HElib
+ cd /Users/redacted/fhe-toolkit-macos/dependencies/HElib
++ pwd
+ cmake -S. -B../HElib_macOS -GXcode -DCMAKE_SYSTEM_NAME=Darwin '-DCMAKE_OSX_ARCHITECTURES=arm64;x86_64' -DCMAKE_OSX_DEPLOYMENT_TARGET=10.10 -DCMAKE_INSTALL_PREFIX=/Users/redacted/fhe-toolkit-macos/dependencies/HElib/_install -DCMAKE_XCODE_ATTRIBUTE_ONLY_ACTIVE_ARCH=NO -DCMAKE_IOS_INSTALL_COMBINED=YES -DGMP_DIR=/Users/redacted/fhe-toolkit-macos/dependencies/gmp -DGMP_HEADERS=/Users/redacted/fhe-toolkit-macos/dependencies/gmp/include -DGMP_LIB=/Users/redacted/fhe-toolkit-macos/dependencies/gmp/lib/libgmp.a -DNTL_INCLUDE_PATHS=/Users/redacted/fhe-toolkit-macos/dependencies/ntl/include -DNTL_LIB=/Users/redacted/fhe-toolkit-macos/dependencies/ntl/lib/ntl.a -DNTL_DIR=/Users/redacted/fhe-toolkit-macos/dependencies/ntl/include
CMake Error: The source directory "" does not exist.
Specify --help for usage, or press the help button on the CMake GUI.
+ echo ' — — — — — — — — — — Building Dependencies Script Ended — — — — — — — — — — '
 — — — — — — — — — — Building Dependencies Script Ended — — — — — — — — — —

Hi @wilfred-centrality,
This seems to be a problem with the version of cmake.
Other collaborators have reported that cmake vesrion 3.17 works. Can you let us know if it resolves your issue, please?
Thank you.

Flavio,
I get the error using Cmake 3.17.3 for MAC OS.  Downloaded binary directly from GitHub
Thanks
JJS

On Jun 14, 2020, at 6:25 AM, Flavio Bergamaschi<EMAIL_ADDRESS>wrote:
Hi @wilfred-centrality https://github.com/wilfred-centrality,
This seems to be a problem with the version of cmake.
Other collaborators have reported that cmake vesrion 3.17 works. Can you let us know if it resolves your issue, please?
Thank you.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/IBM/fhe-toolkit-macos/issues/11#issuecomment-643753323, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACCMJ26ZX5S4F3ISMUZ24ULRWSXTLANCNFSM4NYSAAXA.

Hi @jjsenay I am just following up to see if this is still an issue. Flavio has been busy the last couple of days with the release and @boland25 has been focused on something else (though he should be back in the swing of things Monday or Tuesday of next week). Hang in there. Maybe Monday or Tuesday @boland25 or @faberga  can get some time with you to do some debugging done?

IBM,
Nobody has provided guidance on the Cmake question.  I will hang tight till next Wednesday.
Thanks
JJS

On Jun 18, 2020, at 1:09 PM, Eli M. Dow<EMAIL_ADDRESS>wrote:
Hi @jjsenay https://github.com/jjsenay I am just following up to see if this is still an issue. Flavio has been busy the last couple of days with the release and @boland25 https://github.com/boland25 has been focused on something else (though he should be back in the swing of things Monday or Tuesday of next week). Hang in there. Maybe Monday or Tuesday @boland25 https://github.com/boland25 or @faberga https://github.com/faberga can get some time with you to do some debugging done?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/IBM/fhe-toolkit-macos/issues/11#issuecomment-646224171, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACCMJ2Y6XKYPKDPRZPCGMLTRXJJ4ZANCNFSM4NYSAAXA.

@wilfred-centrality can you send us the complete log file,, please?
Thank you

@jjsenay from the terminal session where you are trying to install the toolkit, can you send us the output of the command
cmake --version

Thank you. Flavio

IBM,
Are there any more logs than theses?
Show-MacBook-Pro-2:~ johnsenay$ cmake --version
cmake version 3.17.3
CMake suite maintained and supported by Kitware (kitware.com/cmake).
Show-MacBook-Pro-2:~ johnsenay$
Thanks
John J. Senay

On Jun 22, 2020, at 1:23 PM, Flavio Bergamaschi<EMAIL_ADDRESS>wrote:
@wilfred-centrality https://github.com/wilfred-centrality can you send us the complete log file,, please?
Thank you
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/IBM/fhe-toolkit-macos/issues/11#issuecomment-647696015, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACCMJ27YZILZGXWUBFOW2GTRX6ORXANCNFSM4NYSAAXA.

@jjsenay what I am looking for is the output that is printed to the terminal after running the ./setup.sh script.  That will be able to tell me where your dependency build is failing.  I suspect that the cmake fails because something in the chain before it is failing.  It would be most helpful if I could see that

Gregory
Thanks
John J. Senay

On Jun 23, 2020, at 9:14 PM, Gregory Boland<EMAIL_ADDRESS>wrote:
@jjsenay https://github.com/jjsenay what I am looking for is the output that is printed to the terminal after running the ./setup.sh script. That will be able to tell me where your dependency build is failing. I suspect that the cmake fails because something in the chain before it is failing. It would be most helpful if I could see that
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/IBM/fhe-toolkit-macos/issues/11#issuecomment-648540475, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACCMJ22BJIB55AUXPRO773TRYFOSDANCNFSM4NYSAAXA.

@jjsenay  were you able to get the console output and attach it here as @boland25 requested? We definitely want to help you get going with this, but without some information, we are not able to provide further guidance at this time.  Can you let us know if you are still working on this?

Eli,
Yes I did.  It is the attached Cmake_build.rtf file
JJS

On Jun 29, 2020, at 11:45 AM, Eli M. Dow<EMAIL_ADDRESS><EMAIL_ADDRESS>wrote:
@jjsenay https://github.com/jjsenay were you able to get the console output and attach it here as @boland25 https://github.com/boland25 requested? We definitely want to help you get going with this, but without some information, we are not able to provide further guidance at this time. Can you let us know if you are still working on this?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/IBM/fhe-toolkit-macos/issues/11#issuecomment-651236569, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACCMJ2Z6EXEUZSA5BXYPR43RZDAMNANCNFSM4NYSAAXA.

just a test to attach a log. @jjsenay I don't see anything attached from you in this thread. How are you attaching them?
test.rtf.log

@jjsenay yes I can see @dowem's attached test log, but I do not see yours anywhere.

All,
I am trying another email account.  I am sending the attachments via<EMAIL_ADDRESS><EMAIL_ADDRESS> It is my business account on Protonmail
Sorry for the problems!!
Thanks
JJS

On Jun 29, 2020, at 1:10 PM, Gregory Boland<EMAIL_ADDRESS>wrote:
@jjsenay https://github.com/jjsenay yes I can see @dowem https://github.com/dowem's attached test log, but I do not see yours anywhere.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/IBM/fhe-toolkit-macos/issues/11#issuecomment-651277727, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACCMJ2Y33INF4LBU367G23TRZDKI3ANCNFSM4NYSAAXA.

Hi Again,
I am not sure what you mean by trying another email account. You may be viewing this discussion in an email reader, but to do the attachment, you should  be editing and posting in GitHub at this url
https://github.com/IBM/fhe-toolkit-macos/issues/11
If you go to the URL above, from within github, you can copy the logs by dragging and dropping them here. If you had been attaching files as email responses, I expect they are not making it to the source github issue where the team is looking for your uploads.

Here are the log files,
Thanks
JJS
Cmake_build.txt
CMakeOutput.log
CMakeError.log

ok, thanks for doing that.  I am looking at the output and it seems like the script is calling xcrun --show-sdk-platform-path but it can't seem to find it.
Do you have Xcode and xcode's command line tools installed?  If you don't have Xcode you can download that from the App Store, and the command line tools can be installed by typing this into your terminal xcode-select --install.  If you do have Xcode and its command line tools installed perhaps there are several versions on your machine so maybe you might need to specify which one.  In that case you can try xcode-select -switch /Applications/Xcode.app/Contents/Developer.  If that didn't work, you can try to reset the path to its default by trying  xcode-select --reset.  please try this and re-run the setup.sh script to see if anything was resolved.

All,
Sorry about the delay.  The fHE compiled!!!  I will be doing more exploration next week.
Cannot thank the TEAM enough!!
JJS
Success.pdf

We are happy to hear you have HElib compiled @jjsenay! Shall we leave this issue open until you can validate that you can run the privacy-preserving search application, or shall we close this issue for now?


Upgrade dgeni packages

Backwards incompatible changes in Nunjucks are explained in the dgeni-packages changelog.
This pull request is to address issue #14.

Coverage increased (+11.1%) to 57.505% when pulling 0def13e1ebdd3bbb1dd0c072132ec4a959799857 on wrporter:upgrade-dgeni-packages into 10e219fd089cc71ba2af09f059bd6a189b8c862e on wingedfox:master.

Coverage increased (+11.1%) to 57.505% when pulling 0def13e1ebdd3bbb1dd0c072132ec4a959799857 on wrporter:upgrade-dgeni-packages into 10e219fd089cc71ba2af09f059bd6a189b8c862e on wingedfox:master.

Thank you, merged.


Unification result blocked from view

v2.36.19
?- [[_|A]|A] = [[_|B]|C].
   B = A, C = A.
?- [[_|A]|A] = [[A|B]|C].
   true.       % ^ This A practise information hiding. Why?
?- [[A|B]|C] = [[_|A]|A].
   B = A, C = A.

Uninteresting issue. Closed.


Increase count due to expired cert today - extra display line

Issue:
Pester testing failing due to additional line showing up caused by expired cert.
Reason:
Need pester testing to work to allow other PRs to work.
Fix:
Increase the display count.
Validation:
Pester tested, verified the cert expired today.

/azp run


Changelog generation fails if git 1.8.x is installed

Changelog generation fails if git 1.8.x is installed

Fixed


Event emitter subscription leak

Error seen:
(node:96785) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 ready listeners added. Use emitter.setMaxListeners() to increase limit
Repro code:
		const c = new SftpClient();
		for (let i = 0; i < 50; i++) {
			await c.connect({
				host: '<IP_ADDRESS>',
				port: 2222,
				username: /*...*/,
				password: /*...*/,
			});
			await c.end();
		}

I might be misreading what my debugger is telling me, but it seems that https://github.com/jyu213/ssh2-sftp-client/blob/4adc77c1df4f5076c967aa973065841e1fda3abf/src/index.js#L430 is adding a .on('ready') subscription every time the client connects, but never removing them. My theory is that after repeated reconnects, the number of ready subscribers causes an exception to be thrown by EventEmitter.

Any update on that?

I've changed all .on to .once for the client, and that did the trick. Not sure if it may break anything else though.
Here is a link to the similar issue
https://github.com/mscdex/ssh2/issues/583

@tylik1 could you possibly create a pull-request for your fix? It'd be great to have it in the mainline codebase.

@ddurschlag6river sorry but i'm not sure that this is a bulletproof solution. I've tested several times, but still one time i've encountered the same bug even with fix applied (

connect support client method , sftp.connect(options, clientMethod),
but loop execute connect will also create multiple connections before it end

@jyu213 I'm not sure I follow. Both the connect and the end are awaited, so they should their execution should alternate -- a connect, then an end, then loop and do it again.

I encountered the same error, by trying to download multiple files. For me the problem seems to be the following code, which adds an eventlistener on this.client for every file it is trying to download, and this eventually adds up to over 11 eventlisteners.
https://github.com/jyu213/ssh2-sftp-client/blob/edfac498c662e608008d8157262612d3d851d013/src/index.js#L109-L111
I added the following line of code to line 10 of index.js, to suppress the error.
this.client.setMaxListeners(0);

See a related issue in the base ssh2 package:
https://github.com/mscdex/ssh2/issues/717#issuecomment-406801109
Basically, it seems that re-using client objects is, in general, a bad idea.

I have the same issue using the sftp.get() function. In my case, I want to pipe the chunks through gunzip to unzip the files 'on the fly'. While it is working, I keep getting the warning about possible memory leak. I do add listeners for 'finish' and 'end' (it is wrapped in a promise) and I do use 'once' rather than 'on' and I do call removeListener and still get this warning. Note that using a separate connection for each file is not really a solution as it results in the target sftp server resetting the connections (I'm assuming due to it seeing too many connectiions from the same host in a very short period). My function/promise is called via await, so never transferring more than 1 file at a time.  I feel the advice to not reuse connections for multiple downloads is really just side stepping the problem. Looking at the provided links, there does not seem to be any justification for why it is  a bad idea.

I'm seeing this error in version 3.1.0. Running node with --trace-warnings shows:

(node:24404) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 error listeners added. Use emitter.setMaxListeners() to increase limit
    at _addListener (events.js:280:19)
    at Client.addListener (events.js:297:10)
    at Promise (C:\Work\MDXConnect\src\node\portal\node_modules\ssh2-sftp-client\src\index.js:25:25)
    at new Promise (<anonymous>)
    at SftpClient.list (C:\Work\MDXConnect\src\node\portal\node_modules\ssh2-sftp-client\src\index.js:21:12)

I believe \ssh2-sftp-client\src\index.js:25 is the cause of the problem:

this.client.on('error', (err) => {

Every time list() is called, SftpClient is adding an error handler to this.client, but this handler is never removed. (See https://stackoverflow.com/questions/23893872/how-to-properly-remove-event-listeners-in-node-js-eventemitter.)
I believe every call to this.client.on('error'... (and manySftpClient functions do this - list(), get(), put(), mkdir(), rmdir(), delete(), rename(), etc.) needs to remove this event listener before returning. Otherwise if a user makes a few calls on an open SFTP connection they will encounter the MaxListenersExceededWarning.

I'm testing a fix to the two functions that I call the most (list() and get()) which removes the client error event handler before resolving/rejecting. It seems to work for me.
SftpClient-fix.js.txt

That looks interesting. I will try to find the time to test it out as well.
On Fri, 28 Sep 2018 at 18:13, arachnetech<EMAIL_ADDRESS>wrote:

I'm testing a fix to the two functions that I call the most (list() and
get()) which removes the client error event handler before
resolving/rejecting. It seems to work for me.
SftpClient-fix.js.txt
https://github.com/jyu213/ssh2-sftp-client/files/2427349/SftpClient-fix.js.txt
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/jyu213/ssh2-sftp-client/issues/78#issuecomment-425358351,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABhUKRXcV-xhAYuyueqeCXUEbbCaZlolks5ufdoMgaJpZM4U_-lR
.

--
regards,
Tim
--
Tim Cross

@arachnetech This is possibly a partial fix. However, when running the test suite, I see that the same warning is generated for the 'stat' command. This command does not add any event listeners (I'm guessing they are being added by the underlying ssh2 module). So your patch would appear to reduce the problem, but not resolve it.

I have submitted a pull request which I think fixes this issue. In looking deeper into the code, I don't think the majority of the this.client.on('error', ....) listeners are required, so removed them. All tests appear to be passing.

Thanks, that’s great!

Hey all,
This has been an issue that was bugging one of our implementations too. (piping files from SFTP location to a S3 bucket). I seems to have solved this issue by doing
sftp.client.removeAllListeners('error');

after each of the promises have been awaited.

@rhasthimuni Yes, that would probably also work, though it can be a little dangerous to do a removeAllListeners when you are reusing the same client connection. Having said that, I don't think the original version requires all the .on error listeners that it adds. Many of the methods are just using low level ssh2 calls which encapsulate the logic and handle events, so no need to add listeners at this level - 2 possible exceptions are get/put, which return streams (though I would add listeners to the stream, not the client)..
the pull request I have submitted removes most of the on error listeners - you really just need one on error listener on the client and odn't need to add another one every time you call a new method (which is the cause of the main issue). I've been using it now for a week and have not observed the memory leak warning.

@rhasthimuni Yes, that would probably also work, though it can be a little dangerous to do a removeAllListeners when you are reusing the same client connection. Having said that, I don't think the original version requires all the .on error listeners that it adds. Many of the methods are just using low level ssh2 calls which encapsulate the logic and handle events, so no need to add listeners at this level - 2 possible exceptions are get/put, which return streams (though I would add listeners to the stream, not the client)..
the pull request I have submitted removes most of the on error listeners - you really just need one on error listener on the client and odn't need to add another one every time you call a new method (which is the cause of the main issue). I've been using it now for a week and have not observed the memory leak warning.

Yeah i do realize its not ideal to remove all listeners from the client, but with our implementations, it seems to be alright although it is a workaround. However I started with using the changes you have submitted (by loading your PR as a locally loaded library) and it didnt seem to solve my issue. May be because how we send the .get() stream in to a S3 .upload() via a stream.PassThrough and then resolving the upload promise. In any case i'll keep an eye out for a better solution or debug why your solution dosent seem to work for me and update this thread.

@rhasthimuni Would be very interested in any additional details you can provide re: issue with .get. We are using that method and sending the data through zlib.gunzip so that we can gunzip files 'on the fly'. We also wrap it inside a promise and it seems to be working well.  Internally, it is using .pipe().
It is possible (likely?) my fix has reduced, but not yet eliminated the issue - I was somewhat conservative with changes to get/put due to the additional potential complexity wrt streams (compared to the other methods that is). I'm guessing you are 'getting' more files than we are and see the emitter warning when we don't hit the magick 10 (on average, we are retrieving 73 files that are gunzipped on the fly.
The only issue we have run into at the moment is a problem if we try to create new connections too quickly - we either get a timeout or errors about directories not existing. hard to reproduce and not sure if it is a module issue or a local network issue at this point. Solved it for now by putting a 30 second delay between new connections (we do retrieve multiple files wiht a single connection).
The other problem we have encountered is with Node v10, but this seems to be related to the underlying ssh2 module. With node 10.x, the .fastGet method hangs after downloading the first 'chunk'. I've reported this to the ssh2 maintainers, but need to generate a reproducible test case (next on my list).

thanks for @rhasthimuni 's merge request. publish a new version @2.4.0 resolve it.

thanks for @rhasthimuni 's merge request. publish a new version @2.4.0 resolve it.

Hey.. I believe its @theophilusx 's PR.. :)

Ok... since @theophilusx 's merge got published (2.4.0) it seems to have fixed our issue.. ive removed
sftp.client.removeAllListeners('error');

and the memory leak warning hasnt come up yet. Will report after some observation
@theophilusx ...Thanks mate ;)

I think this issue is now resolved and can be closed


Is there a way to make .tube() more tree-like?

Hello!
I have recently begun using demesdraw and have really enjoyed it! I was wondering if there is a way to make the output of .tube() to appear more tree-like. For example here are the two demes graphs for a three-taxon tree which is a subset of the larger four-taxon tree.
Three-taxon tree:
description: IUA
time_units: generations
demes:
- name: P123
  epochs:
  - {end_time: 2400000.0, start_size: 1000000.0}
- name: P12
  ancestors: [P123]
  epochs:
  - {end_time: 1200000.0, start_size: 1000000.0}
- name: P3
  ancestors: [P123]
  epochs:
  - {end_time: 0.0, start_size: 1000000.0}
- name: P2
  ancestors: [P12]
  epochs:
  - {end_time: 0.0, start_size: 1000000.0}
- name: P1
  ancestors: [P12]
  epochs:
  - {end_time: 0.0, start_size: 1000000.0}
pulses:
- {source: P3, dest: P2, time: 200000.0, proportion: 0.1}

Four-taxon tree:
description: Introgression from P3 to P2 with an introgression proportion of 0.1 at
  time 200000.0
time_units: generations
demes:
- name: P1234
  epochs:
  - {end_time: 16000000.0, start_size: 1000000.0}
- name: P123
  ancestors: [P1234]
  epochs:
  - {end_time: 2400000.0, start_size: 1000000.0}
- name: P4
  ancestors: [P1234]
  epochs:
  - {end_time: 0.0, start_size: 1000000.0}
- name: P12
  ancestors: [P123]
  epochs:
  - {end_time: 1200000.0, start_size: 1000000.0}
- name: P3
  ancestors: [P123]
  epochs:
  - {end_time: 0.0, start_size: 1000000.0}
- name: P2
  ancestors: [P12]
  epochs:
  - {end_time: 0.0, start_size: 1000000.0}
- name: P1
  ancestors: [P12]
  epochs:
  - {end_time: 0.0, start_size: 1000000.0}
pulses:
- {source: P3, dest: P2, time: 200000.0, proportion: 0.1}

I then plot both graphs with the following code:
# Load graphs.
three_taxon = demes.load('./data/demes_yamls/three_taxon_tree_graph_f_01.yaml')
four_taxon = demes.load('./data/demes_yamls/four_taxon_tree_graph_f_01.yaml')
# Visualize the graphs.
fig, ax = plt.subplots(figsize=(12,9))
demesdraw.tubes(three_taxon, ax=ax, title='Three-Taxon Tree', seed=42)
plt.show()
fig, ax = plt.subplots(figsize=(12,9))
demesdraw.tubes(four_taxon, ax=ax, title='Four-Taxon Tree', seed=42)
plt.show()

Which outputs:

I find the three-taxon tree visualization very appealing and would like to view the four-taxon tree in that "tree-like" manner as well. I know the documentation says that demesdraw focus at the moment is to create example for the demes documentation, but was wondering if there is functionality to make the .tube() more tree-like?
Thanks!
-Dave

Hi @David-Peede,
At the moment, your best option is to manually specify the horizontal positions of the demes. Because the tube width is the size of the deme, I usually space the demes out by the maximum size of all demes usuing the demesdraw.utils.size_max() function. To get you started, here's a custom layout for your four-taxon example.
import demes
import demesdraw

graph = demes.load("four.yaml")

w = 1.5 * demesdraw.utils.size_max(graph)
positions = dict(P1234=0, P4=-w, P123=w, P12=2 * w, P3=3 * w, P2=4 * w, P1=5 * w)
ax = demesdraw.tubes(graph, positions=positions, log_time=True)
ax.figure.savefig("graph.png", dpi=200)

Ahhh I see, makes sense! Thank you very much and I look forward to using this package more and more!


[Issue] Property module is not allowed?

[x] Make sure you've installed the latest version using instructions in the wiki

Output from azd version
Run azd version and copy and paste the output here:
azd version 0.8.0-beta.2 (commit 429b6ccf9a9d1616efa8988f2f8561deeb464c71)
Describe the bug
Property module is flagged as invalid by the language server in vscode. However, removing this property and running azd deploy throws the following error:

To Reproduce

create an azure.yaml file with a service that uses the module  property
open azure.yaml in vscode
notice validation error
remove module property from azure.yaml
run azd up.
notice error.

Expected behavior
Property module should not be wrongly flagged as not allowed.
Additional context
Adding the module property back, and ignoring the language server error, works as expected.
VSCode version:
Version: 1.78.0-insider (user setup)
Commit: d6290ef6582acecbf3bca1558111f2ee64375801
Date: 2023-04-27T05:20:48.295Z
Electron: 22.4.8
Chromium: 108.0.5359.215
Node.js: 16.17.1
V8: <IP_ADDRESS>-electron.0
OS: Windows_NT x64 10.0.22624
Sandboxed: Yes

This property will be deprecated in a future release.  Resolved with #2047 for now.


Fix doc, Tutorials / Create a Rust worker

Thank you for the exciting project!

Thanks @taisukef for your patch! LGTM!


[BUG] OpenSearch sink obscuring ingestion exceptions

Describe the bug
OpenSearch ingestion failures are being obscured by the OpenSearch sink logging. I encountered this due to a mappings exception from OpenSearch. DataPrepper only logged:
WARN  org.opensearch.dataprepper.plugins.sink.opensearch.OpenSearchSink - Document [******] has failure.

The OpenSearch logs had to be inspected to determine the true cause of failure.
Expected behavior
The exception that prevented the document from being ingested into OpenSearch should be logged by DataPrepper for ease of debugging by users.
Additional context
Log is generated from here: https://github.com/opensearch-project/data-prepper/blob/74dbff0835298cee3ddf2cef9fb20be8baa755b2/data-prepper-plugins/opensearch/src/main/java/org/opensearch/dataprepper/plugins/sink/opensearch/OpenSearchSink.java#L321

This appears to be happening when the HTTP request is successful, but some document(s) has an error.
We should do something similar to this, in the particular block where this is happening.
https://github.com/opensearch-project/data-prepper/blob/71415bbb430338cafd10aa8783067bbf1ba8ac2b/data-prepper-plugins/opensearch/src/main/java/org/opensearch/dataprepper/plugins/sink/opensearch/OpenSearchSink.java#LL297C10-L297C100

Hello,
Can I take this up, if it is still available ?


Clojurephant and Gradle fail to resolve and compile transitive dependencies when using composite builds.

Expected Behavior
I expect Gradle composite builds to capture transitive dependencies for Clojure code, transitive dependencies for Clojure to Java code, and to compile all necessary Clojure code just as it does when the composite build is not used and instead the jar is downloaded from Clojars. I expect this to work even if the artifact does not yet exist on Clojars.
Current Behavior
Gradle cannot find the transitive dependencies or compile those Clojure based transitive dependencies. Of course, this works if all the dependencies are Java based dependencies with class files inside. The problem occurs when Clojure code and Clojurephant are being used. Using AOT can partially help, but still, the project will not succeed. The example project I have attached has both Clojure and Java transitive dependencies. Using AOT I can get one level of transitive dependencies. If I specify AOT for all the dependencies, that works... except for the Java dependencies. When the Clojure code depends on Java code, the Java dependencies don't make it to Project A from Project B. See the example project and the README.md.
Context
I'm using composite builds to avoid publishing my projects to maven while debugging. Some of my projects are Clojure code with Gradle as the build tool. It would be exceptionally useful if I could debug a dependent project and use Gradle's composite build feature to automatically and seamlessly include the changes before publishing those changes. Especially given the changes may be debugging code and not even potential fixes.
Steps to reproduce
I have attached two sample projects that work together using Gradle's composite build feature. Execute ./gradlew run from project-a and observe the build fails. I would expect the build to succeed and output - among other things - "hi from b".
Environment

Build scan URL: https://gradle.com/s/cx7zjtxz4n4ny
clojurephant version: 0.6.0
Gradle 7.3.3
java version "11.0.6" 2020-01-14 LTS
macOS 12.5

clojurephant-composite-builds.zip

This is mostly a general Gradle issue, but one we should document better on our side.
Gradle has a pretty involved set of views on the classpath that are used in different contexts:

compileClasspath (a resolvable configuration)

Description: What the current project needs to compile itself
Includes dependencies from apiCompileOnly, api, compileOnly, and implementation
Transitively includes (for lack of a better term) exported compile dependencies (e.g. those that would be in the compile scope of a Maven POM)

runtimeClasspath (a resolvable configuration)

Description: What the current project needs to run itself
Includes dependencies from api, implementation, and runtimeOnly
Transitively includes exported runtime dependencies (e.g. those that would be in the runtime scope of a Maven POM)
As with Java's compile tasks in Gradle, the compileClojure and checkClojure tasks use the source set's compileClasspath. However, Gradle doesn't just distinguish between compile and runtime, they also distinguish between dependencies that should be "exported" as compile dependencies and "exported" as runtime dependencies.

apiElements (an outgoing configuration)

Description: What another project would need to compile against the current project
Includes the JAR (with compiled classes and/or Clojure sources)

By default no dependencies are exported via this configuration
With java-library enabled the api and apiCompileOnly dependencies are exported

If you have a project dependency on a project, this is the configuration that's pulled in at compile time

runtimeElements (an outgoing configuration)

Description: What another project would need to run with the current project
Includes the JAR (with compiled classes and/or Clojure sources)

Exports all runtimeClasspath dependencies

If you have a project dependency on a project, this is the configuration that's pulled in at runtime

So in this case, because your project-b dependencies are in the implementation bucket they won't be exported via apiElements. And unless you use the java-library plugin instead of application you won't even have the api configuration that could export them.
I think the main two options are either:

If appropriate, use the java-library plugin instead of application and declare your project-b dependencies (needed for compile) in the api configuration
Configure apiElements to extend implementation in project-bconfigurations.apiElements {
  extendsFrom(configurations.implementation)
}

Here's some additional background in Gradle's docs:
Java Library Plugin
Maven POM dependency mapping to Gradle variants

Thank you, Andrew.
I did not try solution 1 but I did try solution 2 and it worked.
The only reason I used the application plugin for project-b was so that I could run it and test it to be sure things were working and the problem wasn't actually in project-b. Originally, I did not include that plugin. The application plugin is not included in my production code that this example is drawn from.
This solution will work for me. Thank you so much for spending time on this!

Glad to hear that worked for you! For future reference, I added a new doc to try to explain this.
https://clojurephant.dev/clojurephant/main/explanation/dependencies.html

Thanks Andrew! The documentation you wrote looks great! I suggestion one addition somewhere. It would be good to mention Gradle's "composite build" feature anywhere in the documentation you wrote. I don't think it's necessary to go into detail, but have the words there will make the document turn up in a Google search (as this issue will already, of course). It could be as simple as in the "Consumable Configurations" section adding a sentence to the first paragraph stating "Downstream consumers can be from a composite build, parent project, ..." and whatever else, I don't know Gradle well enough to know what all should be listed there. But having a short list of examples of downstream consumers would have helped me a lot.

@jzwolak Good suggestion, I've added a note about this to the doc


VisibilityPlaceWorker Logging

As discussed via steam, subj method appears to be doing excessive logging.
Since it has been mentioned that there is no logging calls in the method, this is likely a 'me' issue, but any assistance would be appreciated.
UnityEngine.StackTraceUtility:ExtractStackTrace ()
Verse.Log:Message (string)
BetterCV.BetterCVUtil:isOverWall (Verse.BuildableDef)
BetterCV.BlocksConstruction:_Postfix (Verse.Thing,Verse.Thing,bool&)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:RimWorld.GenConstruct.BlocksConstruction_Patch10 (Verse.Thing,Verse.Thing)
RimWorld.GenConstruct:FirstBlockingThing (Verse.Thing,Verse.Pawn)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:RimWorld.WorkGiver_ConstructDeliverResourcesToFrames.JobOnThing_Patch1 (RimWorld.WorkGiver_ConstructDeliverResourcesToFrames,Verse.Pawn,Verse.Thing,bool)
RimWorld.WorkGiver_Scanner:HasJobOnThing (Verse.Pawn,Verse.Thing,bool)
RimWorld.JobGiver_Work/<>c__DisplayClass3_1:<TryIssueJobPackage>g__Validator|0 (Verse.Thing)
Verse.RegionProcessorClosestThingReachable:ProcessThing (Verse.Region,Verse.Thing)
Verse.RegionProcessorClosestThingReachable:RegionProcessor (Verse.Region)
Verse.RegionTraverser/BFSWorker:BreadthFirstTraverseWork (Verse.Region,Verse.RegionEntryPredicate,Verse.RegionProcessor,int,Verse.RegionType)
Verse.RegionTraverser:BreadthFirstTraverse (Verse.Region,Verse.RegionEntryPredicate,Verse.RegionProcessor,int,Verse.RegionType)
Verse.RegionTraverser:BreadthFirstTraverse (Verse.Region,Verse.RegionProcessorDelegateCache,int,Verse.RegionType)
Verse.GenClosest:RegionwiseBFSWorker_NewTemp (Verse.IntVec3,Verse.Map,Verse.ThingRequest,Verse.AI.PathEndMode,Verse.TraverseParms,System.Predicate`1<Verse.Thing>,System.Func`2<Verse.Thing, single>,int,int,single,int&,Verse.RegionType,bool,bool)
Verse.GenClosest:ClosestThingReachable_NewTemp (Verse.IntVec3,Verse.Map,Verse.ThingRequest,Verse.AI.PathEndMode,Verse.TraverseParms,single,System.Predicate`1<Verse.Thing>,System.Collections.Generic.IEnumerable`1<Verse.Thing>,int,int,bool,Verse.RegionType,bool,bool)
Verse.GenClosest:ClosestThingReachable (Verse.IntVec3,Verse.Map,Verse.ThingRequest,Verse.AI.PathEndMode,Verse.TraverseParms,single,System.Predicate`1<Verse.Thing>,System.Collections.Generic.IEnumerable`1<Verse.Thing>,int,int,bool,Verse.RegionType,bool)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:RimWorld.JobGiver_Work.TryIssueJobPackage_Patch0 (RimWorld.JobGiver_Work,Verse.Pawn,Verse.AI.JobIssueParams)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:Glue:AbiFixup<Verse.AI.ThinkResult RimWorld.JobGiver_Work:TryIssueJobPackage(Verse.Pawn, Verse.AI.JobIssueParams),Verse.AI.ThinkResult RimWorld.JobGiver_Work.TryIssueJobPackage_Patch0(RimWorld.JobGiver_Work, Verse.Pawn, Verse.AI.JobIssueParams)> (RimWorld.JobGiver_Work,Verse.AI.ThinkResult&,Verse.Pawn,Verse.AI.JobIssueParams)
Verse.AI.ThinkNode_PrioritySorter:TryIssueJobPackage (Verse.Pawn,Verse.AI.JobIssueParams)
Verse.AI.ThinkNode_Priority:TryIssueJobPackage (Verse.Pawn,Verse.AI.JobIssueParams)
Verse.AI.ThinkNode_Tagger:TryIssueJobPackage (Verse.Pawn,Verse.AI.JobIssueParams)
Verse.AI.ThinkNode_Subtree:TryIssueJobPackage (Verse.Pawn,Verse.AI.JobIssueParams)
Verse.AI.ThinkNode_Priority:TryIssueJobPackage (Verse.Pawn,Verse.AI.JobIssueParams)
Verse.AI.ThinkNode_Conditional:TryIssueJobPackage (Verse.Pawn,Verse.AI.JobIssueParams)
Verse.AI.ThinkNode_Priority:TryIssueJobPackage (Verse.Pawn,Verse.AI.JobIssueParams)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:Verse.AI.Pawn_JobTracker.DetermineNextJob_Patch1 (Verse.AI.Pawn_JobTracker,Verse.ThinkTreeDef&,bool)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:Glue:AbiFixup<Verse.AI.ThinkResult Verse.AI.Pawn_JobTracker:DetermineNextJob(Verse.ThinkTreeDef&, System.Boolean),Verse.AI.ThinkResult Verse.AI.Pawn_JobTracker.DetermineNextJob_Patch1(Verse.AI.Pawn_JobTracker, Verse.ThinkTreeDef&, System.Boolean)> (Verse.AI.Pawn_JobTracker,Verse.AI.ThinkResult&,Verse.ThinkTreeDef&,bool)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:Verse.AI.Pawn_JobTracker.TryFindAndStartJob_Patch1 (Verse.AI.Pawn_JobTracker)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:Verse.AI.Pawn_JobTracker.EndCurrentJob_Patch4 (Verse.AI.Pawn_JobTracker,Verse.AI.JobCondition,bool,bool)
Verse.AI.Pawn_JobTracker:JobTrackerTick ()
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:Verse.Pawn.Tick_Patch3 (Verse.Pawn)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:Verse.TickList.Tick_Patch2 (Verse.TickList)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:Verse.TickManager.DoSingleTick_Patch6 (Verse.TickManager)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:Verse.TickManager.TickManagerUpdate_Patch2 (Verse.TickManager)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:Verse.Game.UpdatePlay_Patch2 (Verse.Game)
(wrapper dynamic-method) MonoMod.Utils.DynamicMethodDefinition:Verse.Root_Play.Update_Patch1 (Verse.Root_Play)```

Unless I'm blind that stack trace doesn't even mention this mod at all. It seems to be from whatever BetterCV is. Google implies Better Vents but I'm not certain of that.

Oh beans, I literally missed the first line.
IAintBuildingThat.VisibilityPlaceWorker
My apologies, I was knee deep in sleeping pills when I posted this. I'll still take a look at better vents to see what's going on there. May be a weird interaction. May still be a me problem.
What exactly does IAintBuildingThat.VisibilityPlaceWorker call?

The github is where all the code is ;) you can see every line. Specifically the visibility place worker is here:
https://github.com/feldoh/I-Aint-Building-That/blob/b55c8d36d686f7097eec832c29404471edb30593/1.5/Source/I_Aint_Building_That/VisibilityPlaceWorker.cs#L6
I highly recommend posting the entire log if you can rather than snippets, if you don't know what the problem is you may miss important sections ;) that said, I'm certain this has nothing to do with this mod, you can see from the code it only overrides a single function; the IsBuildDesignatorVisible and that only checks if a few keys are held down and checks some settings. The only log lines in the entire mod are once at startup to list what it's made hidable.

Yeah, thought so, I've decompiled the DLL in better vents https://steamcommunity.com/sharedfiles/filedetails/?id=1430094853

and you can immediately see it's logging for every place worker for every tick it's a clear bug in Better Vents

It's just printing out the name of every single place worker that happens to be active every tick hence why you might assume it's this mod, because I've added a placeWorker. It's actually logging all of them not just mine.

Seen; Just actually got to test stuff, and better vents is in fact the main culprit.
Better coolers (Same author) Has a similar issue, just a significantly reduced scale. Removing both mods removes the log spam.
I'll let the author of those mods know it's being weird.
Is 'Log.Message' required for the output of the if on the next line? I don't know enough about what I'm going to assume is either Java, C++, or C#, but I feel like that could likely just be commented out, right?
I appreciate you looking in to this for me. While I may be technically competent, game-dev and decompiling things is not where those talents lay, lol.

Nevermind; You've already let them know.

Is 'Log.Message' required for the output of the if on the next line?

Nope the log message is entirely independent. Also, it's C#

Follow on question; What do you use to decompile/compile the DLLs?

I use Jetbrains DotPeek to just peek around in a DLL or if it's a dependency I can just dig around in Rider.

Roger; Thanks again for the help <3


fixes Error associated with main.py string decode

RDFlib serialisation shouldn't need decoding
Traceback (most recent call last):
  File "/Users/harsh/code/duo-odrl-dpv/dash/main.py", line 665, in generate_policy
    a = g.serialize(format='turtle').decode("utf-8")
AttributeError: 'str' object has no attribute 'decode'

I can't reproduce your error and without the .decode("utf-8") I get:
Traceback (most recent call last):
  File "C:\Python38\lib\site-packages\flask\app.py", line 1523, in full_dispatch_request
    rv = self.dispatch_request()
  File "C:\Python38\lib\site-packages\flask\app.py", line 1509, in dispatch_request
    return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args)
  File "C:\Python38\lib\site-packages\dash\dash.py", line 1383, in dispatch
    response.set_data(func(*args, outputs_list=outputs_list))
  File "C:\Python38\lib\site-packages\dash\_callback.py", line 193, in add_context
    _validate.fail_callback_output(output_value, output)
  File "C:\Python38\lib\site-packages\dash\_validate.py", line 329, in fail_callback_output
    _validate_value(val, index=i)
  File "C:\Python38\lib\site-packages\dash\_validate.py", line 319, in _validate_value
    _raise_invalid(
  File "C:\Python38\lib\site-packages\dash\_validate.py", line 227, in _raise_invalid
    raise exceptions.InvalidCallbackReturnValue(
dash.exceptions.InvalidCallbackReturnValue: The callback for `[<Output `generated.children`>, <Output `data_use_permission.value`>, <Output `modifiers.value`>]`
returned a value having type `bytes`
which is not JSON serializable.

The value in question is either the only value returned,
or is in the top level of the returned list,

and has string representation
`b'@prefix odrl: <http://www.w3.org/ns/odrl/2/> .\n\n<https://example.com/offer> a odrl:Offer ;\n    odrl:permission [ odrl:target <https://example.com/Dataset> ] .\n\n'`

In general, Dash properties can only be
dash components, strings, dictionaries, numbers, None,
or lists of those.

Which python are you using?

Python 3.10. Steps to reproduce: run main.py, Generate Offer, error is shown in a popup.


autocomplete is not a function

I'm having an issue with the auto_complete filter type.
When changing the filter type to text, it all works as expected. When using auto_complete filtering does not work on any of the columns.
Console shows:
TypeError: $(...).autocomplete is not a function

My js code:
let propertiesTable = $('.properties-table').DataTable({
    columnDefs: [
       { type: 'natural', targets: 0 }
     ],
     language: {
          url: dataTablesI18nUrl
      }
  });
  // yadcf DataTable filter init
  yadcf.init(propertiesTable, [{
    column_number: 0,
    filter_type: 'text',
    filter_default_label: (sales_object.language === 'nl') ? 'Typ om te filteren' : 'Type to filter',
  }, {
    column_number: 1,
    // select_type: 'chosen',
    select_type_options: {
        search_contains: true
    },
    filter_default_label: (sales_object.language === 'nl') ? 'Selecteer type' : 'Select type',
  }, {
    column_number: 2,
    // select_type: 'chosen',
    select_type_options: {
        search_contains: true
    },
    filter_default_label: (sales_object.language === 'nl') ? 'Selecteer aantal' : 'Select number',
  }, {
    column_number: 6,
    filter_type: 'auto_complete',
  }]);

PS I commented out select_type: 'chosen', because it too throws an error when used, but works flawlessly when omitted.

Hi
You should add js/css of any third party jquery plugin in order to use them.
See TypeError: $(…).autocomplete is not a function

Thanks, apparently the jquery ui that I was using did not include the entire library.

Encountered into the same problem, as is stated in README

autocomplete input - make use of the jQuery UI Autocomplete widget (with some enhancements)

Solved by including jquery-ui.js before jquery.dataTables.yadcf.js.


Calling RAND_DRBG_get0_public without locks initialized segfaults on platforms without atomics

Hi ,every experts.
I am newbie in Openssl.
I have a issue when call RAND_DRBG_get0_public in program.
The following is the detail information,please help to check what's wrong?
Thanks in advance.
uname -a
Linux linux <IP_ADDRESS>-0.3-default #1 SMP 2011-08-22 10:12:58 +0200 x86_64 x86_64 x86_64 GNU/Linux
cat /etc/SuSE-release
SUSE Linux Enterprise Server 11 (x86_64)
VERSION = 11
PATCHLEVEL = 1

code snap:
static RAND_DRBG *public_drbg;
bool init_drbg(void)
{
	unsigned int reseedinterval = 0;
	time_t health_check_interval = 0;

	public_drbg = RAND_DRBG_get0_public();
	if (public_drbg == NULL)
	{
		return false;
	}
}

core stack information:
#0  0x00007f7a8e455c8a in pthread_rwlock_wrlock () from /lib64/libpthread.so.0
(gdb) bt
#0  0x00007f7a8e455c8a in pthread_rwlock_wrlock () from /lib64/libpthread.so.0
#1  0x00007f7a8dee0d89 in CRYPTO_THREAD_write_lock () from /usr/local/lib64/libcrypto.so.1.1
#2  0x0000000000007cf7 in ?? ()
#3  0x00007f7a8dee0dcc in CRYPTO_atomic_add () from /usr/local/lib64/libcrypto.so.1.1
#4  0x5bf3984a0008b192 in ?? ()
#5  0x0000000000000000 in ?? ()
(gdb)

but when call like following
public_drbg = RAND_DRBG_new(NID_aes_256_ctr, 0, NULL);

the program is ok, not coredump will be issued.

I'm not in a position to check this for the moment, but this sounds like an internal init issue, i.e something wasn't quite as initialized as could be expected...

Are you using the OpenSSL library of your distribution or did you build the library yourself? Which output do you get from openssl version?
I'm a little bit confused, because you seem to be using version 1.1.1 or newer, but according to the package index  the version of the OpenSSL system library is 0.9.8h? Or am I looking in the wrong place?

@levitte @mspncp
Thanks a lot for your quick response .
I will check the version.

In your code snippet you are using the bool type. Is this C99 code or C++? Could you share a short compilable program (together with the compiler command to build it) which exhibits the issue?

@mspncp
openssl version
OpenSSL 1.1.1  11 Sep 2018

//-------------this is my test.c begin-------------------------------------
#include <stdio.h>
#include "obj_mac.h"
#include "rand_drbg.h"
#include "ssl.h"
#define false 0
#define true 1
/* NIST SP 800-90A DRBG recommends the use of a personalization string. */
static const char ossl_pers_string[] = "OpenSSL NIST SP 800-90A DRBG";
static RAND_DRBG *public_drbg;
int init_drbg();
int drbg_bytes(unsigned char *out, int count);
int init_drbg()
{
unsigned int reseedinterval = 0;
time_t health_check_interval = 0;
//	RAND_DRBG *public_drbg = NULL;
//public_drbg = RAND_DRBG_new(NID_aes_256_ctr, 0, NULL);
public_drbg = RAND_DRBG_get0_public();
if (public_drbg == NULL)
{
	return false;
}

/* Initialize the library. This need to be done during the application initialization time */
if (!SSL_library_init())
{
	fprintf(stderr, "Error while performing Library init:\n");
	return false;
}

/* Initialize a pre-existing DRBG context with the required internal algorithm and flag
Based on the algorithm id type internal algorithm will be decided. Select the flag
value as 0, if not performing test */

reseedinterval = 1 << 12;

if (RAND_DRBG_set(public_drbg, NID_aes_256_ctr, 0) != 1)
{
	return false;
}

if (RAND_DRBG_set_reseed_time_interval(public_drbg, health_check_interval) != 1)
{
	return false;
}

if (RAND_DRBG_set_reseed_interval(public_drbg, reseedinterval) != 1)
{
	return false;
}

/*if (!RAND_DRBG_set_callbacks(public_drbg, drbg_get_entropy, drbg_free_entropy,
			drbg_get_nonce, drbg_free_nonce))
{
	return false;
}*/

if (!RAND_DRBG_instantiate(public_drbg,(const unsigned char *) ossl_pers_string,
			sizeof(ossl_pers_string) - 1))
{
	return false;
}

return true;

}
int drbg_bytes(unsigned char *out, int count)
{
int ret;
//	RAND_DRBG *public_drbg = NULL;
ret = RAND_DRBG_bytes(public_drbg, out, count);
return ret;

}
void main()
{
unsigned char result[16];
init_drbg();
drbg_bytes(result,16);
}
//-------------this is my test.c end---------------------------------------
compile command is
gcc -o test -g test.c  -L /home/mypath/openssl/lib -lssl -lcrypto

Something is strange here: You provide -L /home/mypath/openssl/lib but not -I /home/mypath/openssl/include .  Is /home/mypath/openssl your source or your installation directory? And if it's the former, did you install it  in your system? Because the initial crash dump shows /usr/local/lib64/libcrypto.so.1.1.
Please try ldd test and check whether the openssl shared libraries which your test program uses are really identical with the one you think.

Please try ldd test and check whether the openssl shared libraries which your test program uses are really identical with the one you think.

If it picks up the wrong libraries, you might have to set LD_LIBRARY_PATH before running your test program.
What is even more strange is the fact that you implement all these RAND_DRBG_xxx functions yourself. This can't work, they are implemented in libcrypto. You need to remove those implementations.
Also, the correct include directive is #include <openssl/rand_drbg.h>, not  #include "rand_drbg.h". Please provide a more complete description of your developing setup. For example, where is your test.c located and from where does it include rand_drbg.h?

I include realted files in the same path
such as:
libcrypto.a
libcrypto.so
libcrypto.so.1.1
libssl.a
libssl.so
libssl.so.1.1
obj_mac.h
rand_drbg.h
ssl.h
test.c
so  include file should not be the root cause
from ldd test result ,it is the same path.

I include realted files in the same path

What is the absolute path of this directory? If it is  /home/mypath/openssl then your test program is certainly picking up the wrong libraries, because the crash dump shows that libcrypto is at /usr/local/lib64/libcrypto.so.1.1.

make install

Oh, I overlooked that you installed it. So it still might be the same libcrypto, regardless of the path. But there remains the question why you reimplemented the RAND_DRBG_xxx() functions?

IMHO you are creating unnecessary complications with your non-standard setup of copying include files and libraries around. My recommendation is to put your test.c in a separate directory by itself, and use the installed headers and libraries in the intended way.
You can do this by adding the following Makefile to your test directory
OPENSSL_PREFIX=/path-to-your-openssl-installation
CFLAGS=-g -O0 -I${OPENSSL_PREFIX}/include
LDFLAGS=-L${OPENSSL_PREFIX}/lib -lcrypto -Wl,--enable-new-dtags,-rpath,${OPENSSL_PREFIX}/lib

(you need to update /path-to-your-openssl-installation). Then you can build your test program using make test.

@mspncp, where do you get that @kuncao is reimplementing RAND_DRBG_ functions? I don't see it.

linux:~/mypath/openssl/lib> ll
total 11012
-rw------- 1 xufang users<PHONE_NUMBER>-11-21 03:57 core
drwxr-xr-x 2 xufang users    4096 2018-11-21 03:55 engines-1.1
-rw-r--r-- 1 xufang users 5484500 2018-11-21 03:55 libcrypto.a
lrwxrwxrwx 1 xufang users      16 2018-11-21 03:55 libcrypto.so -> libcrypto.so.1.1
-rwxr-xr-x 1 xufang users 3245636 2018-11-21 03:55 libcrypto.so.1.1
-rw-r--r-- 1 xufang users 1026748 2018-11-21 03:55 libssl.a
lrwxrwxrwx 1 xufang users      13 2018-11-21 03:55 libssl.so -> libssl.so.1.1
-rwxr-xr-x 1 xufang users<PHONE_NUMBER>-11-21 03:55 libssl.so.1.1
-rw-r--r-- 1 xufang users<PHONE_NUMBER>-11-21 02:31 obj_mac.h
drwxr-xr-x 2 xufang users    4096 2018-11-21 03:55 pkgconfig
-rw-r--r-- 1 xufang users    4513 2018-11-20 12:26 rand_drbg.h
-rw-r--r-- 1 xufang users<PHONE_NUMBER>-11-21 02:32 ssl.h
-rwxr-xr-x 1 xufang users   15154 2018-11-21 03:57 test
-rw-r--r-- 1 xufang users    1895 2018-11-21 02:33 test.c
linux:~/mypath/openssl/lib> ldd test
linux-vdso.so.1 =>  (0x00007fff72b63000)
libachk.so => /lib64/libachk.so (0x00007ff400dfe000)
libssl.so.1.1 (0x00007ff400a88000)
libcrypto.so.1.1 (0x00007ff4005c2000)
libc.so.6 => /lib64/libc.so.6 (0x00007ff400264000)
libdl.so.2 => /lib64/libdl.so.2 (0x00007ff400060000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x00007ff3ffe43000)
/lib64/ld-linux-x86-64.so.2 (0x00007ff400d19000)

Ok, so it seems that you've changed something, 'cause your crash output clearly shows that you were using a different libcrypto.so.1.1:
#1  0x00007f7a8dee0d89 in CRYPTO_THREAD_write_lock () from /usr/local/lib64/libcrypto.so.1.1
#2  0x0000000000007cf7 in ?? ()
#3  0x00007f7a8dee0dcc in CRYPTO_atomic_add () from /usr/local/lib64/libcrypto.so.1.1

So can you re-run test to see if it still crashes, and if it does, that it indeed uses ~/mypath/openssl/lib/libcrypto.so.1.1 rather than /usr/local/lib64/libcrypto.so.1.1
Incidently, I copied your test program and compiled it against a fresh build of our master branch.  It ran fine, so I'm sorry to say that I cannot reproduce the issue.

@levitte
Thanks a lot
Can you paste your  LD_LIBBRARY_PARH env variable value?

Note: If you use the linker flags provided in https://github.com/openssl/openssl/issues/7870#issuecomment-446500522, it will pick the correct shared libraries even without the help of LD_LIBRARY_PATH.

@levitte @mspncp
Tanks a lot.
I will try the recommended configuration.

Hi,
AFAIK, @kuncao is using SLES 11 SP1. This implies GCC 4.3. This implies no support for C11 atomics, nor the underlying GCC _atomic* builtins. This implies that the pthread locks code path is used.
However, based on code posted by @kuncao , do_rand_init() from rand_lib.c is never called through, since there is no call to e.g. RAND_poll(), RAND_get_rand_method(), etc. So, the pthread locks are... never initialized. Hence the crash.
How to fix?

Have @kuncao upgrade to a modern compiler so that crypto atomics are implemented over C11/GCC atomics. But this probably isn't an option to him, and the issue would remain for others ;
Implement crypto atomics with old-style GCC _sync* primitives. But this probably isn't a good idea either since those are deprecated ;
Make sure that the default get_nonce() implementation have its pthread lock initialized before use? This sounds like the better option. Fortunately, this is implemented in the master branch, AFAICS. Unfortunately, this still is not the case for 1.1.x series.

Do people agree with this analysis?

Hi,
AFAIK, @kuncao is using SLES 11 SP1. This implies GCC 4.3. This implies no support for C11 atomics, nor the underlying GCC _atomic* builtins. This implies that the pthread locks code path is used.
However, based on code posted by @kuncao , do_rand_init() from rand_lib.c is never called through, since there is no call to e.g. RAND_poll(), RAND_get_rand_method(), etc. So, the pthread locks are... never initialized. Hence the crash.
How to fix?

Have @kuncao upgrade to a modern compiler so that crypto atomics are implemented over C11/GCC atomics. But this probably isn't an option to him, and the issue would remain for others ;
Implement crypto atomics with old-style GCC _sync* primitives. But this probably isn't a good idea either since those are deprecated ;
Make sure that the default get_nonce() implementation have its pthread lock initialized before use? This sounds like the better option. Fortunately, this is implemented in the master branch, AFAICS. Unfortunately, this still is not the case for 1.1.x series.

Do people agree with this analysis?

I have the same problem here
I feel confused why it arises in probability if so.
I try to revive this core but I failed.
Though, I will try your solution, thank you for your analysis.

Fix for this in #14603

The version 1.1.1 is not supported anymore. Closing.


  Investigate where this slowness comes from.  If memory serves I don't think it was CPU bound.  Could this be some weird SQLite3 locking madness?

Server was slowed down because of SQLite.  Turned on Write-ahead logging.  Should make this a config option at some point, but this dealth with the slowness.


feat(sfc-playground): add ability to disable automatic url generation

fix: #5192

Could you please resolve the conflicts?

Could you please resolve the conflicts?

@edison1105 I guess this PR has been sitting for so long that this feature has already been implemented by another PR
https://github.com/vuejs/core/pull/11428
I guess we can close this PR.


Drop Not Received

I did not receive space drop, Both for November and December. My account is fully verified. What might be the cause?

How to contact with keybase support? Why i am still not recieved airdrop? Last month i got but this month anything.
My account was approved for join, and not "garbage" as you said. If there any admin or support, check it pls. Public address is
GAZW5TAOGJV5VYKRMH7GAB5ZW3RKIXRFH2QICZJKTYSUP56E3AO5D4HZ


How to use storage manager after installation

Organization Name:

How to use storage manager after installation

Short summary about the issue/question:
I want to use smba storage. After the storage manager is installed, how should I use it
Brief what process you are following:

How to reproduce it:

OpenPAI Environment:

OpenPAI version:v0.17.0
Cloud provider or hardware configuration:
OS (e.g. from /etc/os-release):
Kernel (e.g. uname -a):
Hardware (e.g. core number, memory size, storage size, GPU type etc.):
Others:

Anything else we need to know:

Storage-manager is for k8s  version
Seems you use yarn version. Please refer to this comments: https://github.com/microsoft/pai/issues/4308#issuecomment-601740810. If you use yarn version, please stick to v0.14.0
If you want to upgrade to k8s version. Please refer to https://github.com/microsoft/pai/blob/master/contrib/kubespray/readme.md.
But it's a pre-release. And will bring breaking change

Closing the issue as the question had been answered, thanks @mtzfei and @Binyang2014


chore: removes celotracker for no walletconnect v2 support

Description
Removes Celo Tracker for no WalletConnect v2 support.

@gnardini Do you have plans to add Wallet Connect V2 support?

@gnardini Do you have plans to add Wallet Connect V2 support?

Sadly, no. I looked into it briefly but there are too many breaking changes in rainbowkit to make the update and I don't have the bandwidth for it.
If I ever resume active development for Celo Tracker I'll create a PR to re-add it to this list.

Right makes sense, but in case it's useful, I think the 0.12.x branch of RainbowKit was updated for WC v2 too.
Because dapps couldn't just switch from ethers to viem.
Maybe could work as a stop gap solution without migration work.

That's the path Mento took for now too: https://github.com/mento-protocol/mento-web/pull/69


feat: Adding install instruction for SUSE/openSUSE

Adding install instructions for SUSE and openSUSE Linux variants.
Signed-off-by: Jonas Forsberg<EMAIL_ADDRESS>

Ah yes, we agreed to write "back-end" and not "backend", that's what the failed job is about. I can fix it when merging.

Thanks @SweBarre!


README out of date

It appears head of master is trying to load a reddit json file, I had to checkout an old commit to get things to work.
What is scores.csv and where can I get it, how is it used in the bench?
What versions of Elasticsearch are supported by this benchmark?

@scragg0x this benchmark tool was updated to use the latest elastic driver and is compatible with Elastic8 and RediSearch v2.6.
The readme was updated with the required steps to run the benchmarks


fix: hmr build twice

What kind of change does this PR introduce?
see: https://github.com/webpack/watchpack/pull/215
Did you add tests for your changes?

Does this PR introduce a breaking change?
No
What needs to be documented once your changes are merged?
No

Thanks


No response received at callback url endpoint

Hi, everything is working perfectly well with the api on the android side but the callback endpoint at the server is not receiving any response. Please help

@Aleqi any luck with this.  I having the same problem

@Aleqi @nellycheboi12 You need to define your own callback URL inorder to receive the callbacks. Use this tutorial on how you can use firebase and PHP for that https://www.androidhive.info/2012/10/android-push-notifications-using-google-cloud-messaging-gcm

I have already defined my own callback and previously it was working
perfectly. But since Thursday 29th March, 2018 last week there is no
response being received at my callback endpoint from mpesa server.
On Tue, Apr 3, 2018 at 9:40 AM, Brian Kisese<EMAIL_ADDRESS>wrote:

@Aleqi https://github.com/Aleqi @nellycheboi12
https://github.com/nellycheboi12 You need to define your own callback
URL inorder to receive the callbacks. Use this tutorial on how you can use
firebase and PHP for that https://www.androidhive.info/
2012/10/android-push-notifications-using-google-cloud-messaging-gcm
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/safaricom/LNMOnlineAndroidSample/issues/16#issuecomment-378144519,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AP3rWEZT02-IQVw-PZFpbXf7TgngVkxhks5tkxlUgaJpZM4TC7c6
.

@nellycheboi12  No luck yet

@Aleqi I have the same issue, which kind a bug was it, cant get responses on my callback url. Like the c2b urls, are we suppose to register this STK callback url?

I came to notice that there are some servers that have a problem with this and after several times of retrying Mpesa drop the response

I think thats the reason for my case, I will try changing server

hello @Aleqi
what kind of bug you were getting at api side ? I am implementing Lipa Na Mpesa STK push and I am not getting response at my callback url after transaction .
please help

it's strange. I simply cannot get any response from Safaricom through the callbackurl despite all systems working fine previously. What kind of a bug is this @Aleqi? Hey @nellycheboi did you resolve yours?

Any luck @itsKirk ?

yeah @em-manuel it turned out to be a bug and it was only on sandbox environment. After two days I got a response from Daraja API guys and confirmed the same but all is well now.

This issue is still there. Sometimes it works, most of the time the endpoint doesn't get the response from Safaricom. Frustrating really.

@angwandi,
I have resolved to going straight to production environment to avoid the massive time wastage on the sandbox environment.

@angwandi, I have resolved to going straight to production environment to avoid the massive time wastage on the sandbox environment.

This is the best possible solution

@ngangavic @em-manuel I think I will do the same then. Thank you.
But what's the point of offering a sandbox test account that doesn't work?

Still a problem

Well someone can get the result of the test transaction by querying mpesa with the CheckoutRequestID (this is returned in the body of initial sdk ).One can make a post request to https://sandbox.safaricom.co.ke/mpesa/stkpushquery/v1/query.
I found how to query by login->select APIs->click on query button in the M-Pesa Express card.
Hope this helps those in test env but I would suggest one moves to production to avoid the many hustle of dealing with CheckoutRequestIDs


connect ECONNREFUSED ../Code/1.15.1-shared.sock

hi, i got this message when opening (click) on extension menu, and extenstion list not working
connect ECONNREFUSED /Users/ruby/Library/Application Support/Code/1.15.1-shared.sock
OSX sierra
vs code 1.15.1

Looks like there is some instance of Code hanging on to the above socket. Can you try quitting those dangling Code instances and try again?

@sandy081 , i dont know why, but i think the problem has been fixed after restart the vscode


Add Tokenview Dash Explorer and Dash API to resources-index

Hi there,
I came across your developer resource listing for Dash and found that Tokenview is not listed there. I take this opportunity to bring to your attention that Tokenview has been one of the most popular web3 platforms for developers and has been providing dash explorer (dash.tokenview.io) and  DASH archive API services. We believe that Tokenview would be a great resource for developers looking to quickly and easily deploy their decentralized applications to the cloud on DASH chain. Thank you for your time and consideration.

Preview build: https://dash-docs--58.org.readthedocs.build/projects/core/en/58/

Hi, I've opened an alternate PR to add this to the user docs where we have a list of various options (see dashpay/docs#291). If you want to add some info about your API, feel free to open a PR over there also on this page: https://docs.dash.org/en/stable/docs/user/developers/integration-apis.html. Thanks!


Don't expose stored keys, passwords. Consolidated validation code.

Not tested yet ...

Incorporated into #9


Anothe SINOWEALTH 258a:1007 feature error

Information

ratbagd version (ratbagd --version):0.17
Distribution: Arch Linux
Kernel version (ex. uname -srmo): Linux 6.5.3-zen1-1-zen x86_64 GNU/Linux

Logs
$ ratbagd --verbose=raw
Initializing libratbag
ratbag debug: New device: HID 0e8f:2517
ratbag debug: Using data directory '/usr/share/libratbag'
ratbag debug: No data file found for 0e8f:2517
ratbag debug: New device: HID 0e8f:2517
ratbag debug: Using data directory '/usr/share/libratbag'
ratbag debug: No data file found for 0e8f:2517
ratbag debug: New device: OVERSTEEL TITANIUM Red
ratbag debug: Using data directory '/usr/share/libratbag'
ratbag debug: No data file found for 0c45:5004
ratbag debug: New device: OVERSTEEL TITANIUM Red
ratbag debug: Using data directory '/usr/share/libratbag'
ratbag debug: No data file found for 0c45:5004
ratbag debug: New device: SINOWEALTH Game Mouse
ratbag debug: Using data directory '/usr/share/libratbag'
ratbag debug: device assigned driver sinowealth
ratbag debug: hidraw info: bus 0x03 vendor 0x258a product 0x1007
ratbag debug: SINOWEALTH Game Mouse is device '/dev/hidraw5'.
ratbag debug: Parsing HID report descriptor
ratbag debug: Parsing HID report descriptor
ratbag debug: hidraw info: bus 0x03 vendor 0x258a product 0x1007
ratbag debug: SINOWEALTH Game Mouse is device '/dev/hidraw6'.
ratbag debug: Parsing HID report descriptor
ratbag debug: Parsing HID report descriptor
ratbag debug: - HID report ID 01
ratbag debug: - HID report ID 02
ratbag debug: - HID report ID 04
ratbag debug: - HID report ID 06
ratbag debug: - HID report ID 07
ratbag debug: - HID report ID 08
ratbag debug: - HID report ID 05
ratbag raw: feature set:   05 02 01 00 00 00
ratbag error: Could not set feature report in a write query: -110
ratbag error: Error while selecting profile: -1
ratbag debug: New device: SINOWEALTH Game Mouse
ratbag debug: Using data directory '/usr/share/libratbag'
ratbag debug: device assigned driver sinowealth
ratbag debug: hidraw info: bus 0x03 vendor 0x258a product 0x1007
ratbag debug: SINOWEALTH Game Mouse is device '/dev/hidraw5'.
ratbag debug: Parsing HID report descriptor
ratbag debug: Parsing HID report descriptor
ratbag debug: hidraw info: bus 0x03 vendor 0x258a product 0x1007
ratbag debug: SINOWEALTH Game Mouse is device '/dev/hidraw6'.
ratbag debug: Parsing HID report descriptor
ratbag debug: Parsing HID report descriptor
ratbag debug: - HID report ID 01
ratbag debug: - HID report ID 02
ratbag debug: - HID report ID 04
ratbag debug: - HID report ID 06
ratbag debug: - HID report ID 07
ratbag debug: - HID report ID 08
ratbag debug: - HID report ID 05
ratbag raw: feature set:   05 02 01 00 00 00
ratbag error: Could not set feature report in a write query: -110
ratbag error: Error while selecting profile: -1
ratbag debug: New device: NZXT. - Inc. NZXT USB Device
ratbag debug: Using data directory '/usr/share/libratbag'
ratbag debug: No data file found for 1e71:2007
DBus server ready

Additional context
Tried to lauch piper but mouse not recognized

This is the unsupported type of SinoWealth devices, sorry.
All of them use 258a:1007 ID and give ratbag error: Could not set feature report in a write query: -110. There is a bunch of issues with the same error, literally any of them can be used to track progress (which will only happen if someone reverse engineers and contributes a new driver for libratbag, so this may not ever happen).
For better book-keeping, what is your mouse model?