Analysis for a large file will result in an error.

Before explaining my issue I would like to thank the brilliant mind and kind person who made this tool, well done !
I am trying to run a large file with more then 1500 symbols and 9 years of data. When I  run
mu = expected_returns.mean_historical_return(df)
S = risk_models.sample_cov(df)

I get the following error
/usr/local/lib/python3.6/dist-packages/pypfopt/risk_models.py:69: UserWarning: The covariance matrix is non positive semidefinite. Amending eigenvalues.
  "The covariance matrix is non positive semidefinite. Amending eigenvalues."
/usr/local/lib/python3.6/dist-packages/pypfopt/risk_models.py:88: UserWarning: Could not fix matrix. Please try a different risk model.
  warnings.warn("Could not fix matrix. Please try a different risk model.")`

Adding methods spectral and diag won't change the issue.
After running
ef = EfficientFrontier(mu, S)
weights = ef.max_sharpe()

cleaned_weights = ef.clean_weights()
print(cleaned_weights)
ef.portfolio_performance(verbose=True)`

I get
OptimizationError                         Traceback (most recent call last)
<ipython-input-36-32b004e14f58> in <module>()
      1 #Optimize for the miximal Sharpe ratio
      2 ef = EfficientFrontier(mu, S)
----> 3 weights = ef.max_sharpe()
      4
      5 cleaned_weights = ef.clean_weights()

1 frames
/usr/local/lib/python3.6/dist-packages/pypfopt/base_optimizer.py in _solve_cvxpy_opt_problem(self)
    227
    228         if opt.status != "optimal":
--> 229             raise exceptions.OptimizationError
    230         self.weights = self._w.value.round(16) + 0.0  # +0.0 removes signed zero
    231         return self._make_output_weights()

OptimizationError: Please check your objectives/constraints or use a different solver.`

If I would run a smaller size file with 300 stocks it will usually run (once it did run the second time it didn't and I got the error above)
A file with 100 stocks will run all the time with no issues. I have checked that the data is ok, fixed voids etc.
My code is
#import the python libraries

import pandas as pd
import numpy as np
import requests

#Load the data
df = pd.read_csv('stocks.csv')

#Set the date as the index
df = df.set_index(pd.DatetimeIndex(df['Date'].values))

#Remove the date column
df.drop(columns=['Date'], axis=1, inplace=True)

#Get the assets /tickers
assets = df.columns

#Optimize the Portfolio
from pypfopt.efficient_frontier import EfficientFrontier
from pypfopt import risk_models
from pypfopt import expected_returns

#Calculate the expected annualized returns and the annualize sample covariance matrix of the daily asset returns
mu = expected_returns.mean_historical_return(df)
S = risk_models.sample_cov(df)

#Optimize for the miximal Sharpe ratio
ef = EfficientFrontier(mu, S)
weights = ef.max_sharpe()

cleaned_weights = ef.clean_weights()
print(cleaned_weights)
ef.portfolio_performance(verbose=True)

#Get the discrete allocation of each share per stock
from pypfopt.discrete_allocation import DiscreteAllocation, get_latest_prices

portfolio_val = 5000
latest_prices = get_latest_prices(df)
weights = cleaned_weights
da = DiscreteAllocation(weights, latest_prices, total_portfolio_value = portfolio_val)
allocation, leftover = da.lp_portfolio()
print('Discrete allocation:', allocation)
print('Funds Remaining: $', leftover)

If the data is needed please let me know, and thanks again!#

Hi @Originn,
Thanks for providing detailed code and error messages, it really helps in debugging (FYI, I have reformatted your issue by using triple backticks to make code blocks).
The problem is that with 9 years of daily data, you have about 2250 datapoints (9x252). This is not much larger than the number of assets, leading to numerical issues when calculating the sample covariance matrix.
Could you try a different method for calculating the covariance matrix? For example
S = risk_models.CovarianceShrinkage(df).ledoit_wolf()

These are sometimes able to estimate the covariance matrix even when the number of assets is large relative to the number of datapoints.
If this doesn't work, unfortunately you will either have to get a lot more data, or reduce the size of the asset universe (e.g remove the stocks with the worst expected returns, as these are unlikely to get allocated much anyway).
Let me know how you get on!
Best,
Robert

Hi @Originn,
Thanks for providing detailed code and error messages, it really helps in debugging (FYI, I have reformatted your issue by using triple backticks to make code blocks).
The problem is that with 9 years of daily data, you have about 2250 datapoints (9x252). This is not much larger than the number of assets, leading to numerical issues when calculating the sample covariance matrix.
Could you try a different method for calculating the covariance matrix? For example
S = risk_models.CovarianceShrinkage(df).ledoit_wolf()

These are sometimes able to estimate the covariance matrix even when the number of assets is large relative to the number of datapoints.
If this doesn't work, unfortunately you will either have to get a lot more data, or reduce the size of the asset universe (e.g remove the stocks with the worst expected returns, as these are unlikely to get allocated much anyway).
Let me know how you get on!
Best,
Robert

Thanks a lot Robert!
I have tried to run the same number of stocks but only on 5 years worth of data.
I tried on both
S = risk_models.sample_cov(df)
and
S = risk_models.CovarianceShrinkage(df).ledoit_wolf()
I get the following error
SolverError                               Traceback (most recent call last)
<ipython-input-9-32b004e14f58> in <module>()
      1 #Optimize for the miximal Sharpe ratio
      2 ef = EfficientFrontier(mu, S)
----> 3 weights = ef.max_sharpe()
      4
      5 cleaned_weights = ef.clean_weights()

4 frames
/usr/local/lib/python3.6/dist-packages/pypfopt/efficient_frontier.py in max_sharpe(self, risk_free_rate)
    224         ] + new_constraints
    225
--> 226         self._solve_cvxpy_opt_problem()
    227         # Inverse-transform
    228         self.weights = (self._w.value / k.value).round(16) + 0.0

/usr/local/lib/python3.6/dist-packages/pypfopt/base_optimizer.py in _solve_cvxpy_opt_problem(self)
    222                 opt.solve(solver=self._solver, verbose=self._verbose)
    223             else:
--> 224                 opt.solve(verbose=self._verbose)
    225         except (TypeError, cp.DCPError) as e:
    226             raise exceptions.OptimizationError from e

/usr/local/lib/python3.6/dist-packages/cvxpy/problems/problem.py in solve(self, *args, **kwargs)
    288         else:
    289             solve_func = Problem._solve
--> 290         return solve_func(self, *args, **kwargs)
    291
    292     @classmethod

/usr/local/lib/python3.6/dist-packages/cvxpy/problems/problem.py in _solve(self, solver, warm_start, verbose, parallel, gp, qcp, **kwargs)
    573         full_chain = self._solving_chain.prepend(self._intermediate_chain)
    574         inverse_data = self._intermediate_inverse_data + solving_inverse_data
--> 575         self.unpack_results(solution, full_chain, inverse_data)
    576         return self.value
    577

/usr/local/lib/python3.6/dist-packages/cvxpy/problems/problem.py in unpack_results(self, solution, chain, inverse_data)
    716             raise error.SolverError(
    717                     "Solver '%s' failed. " % chain.solver.name() +
--> 718                     "Try another solver, or solve with verbose=True for more "
    719                     "information.")
    720         self.unpack(solution)

SolverError: Solver 'OSQP' failed. Try another solver, or solve with verbose=True for more information.

I have tried to run it on couple of months and with the same number of stocks and it worked ,although understandably the results were pretty high
Expected annual return: 44442507.9%
Annual volatility: 392.8%
Sharpe Ratio: 113138.39

As you suggested, maybe I will need to run this on 200 stocks at a time (with 9 years of data), keep the best performing stocks until I'll be left with 200 best stocks and run it one last time.
I am quite a beginner in code writing, but I'll try to write a loop that will do it, and if I am successful I will post here. Do you think it is possible? Any help/guidance in writing it will be greatly appreciated!
Thanks!
Ori

Thanks a lot Robert!
I have tried to run the same number of stocks but only on 5 years worth of data.
I tried on both
S = risk_models.sample_cov(df)
and
S = risk_models.CovarianceShrinkage(df).ledoit_wolf()
I get the following error
SolverError                               Traceback (most recent call last)
<ipython-input-9-32b004e14f58> in <module>()
      1 #Optimize for the miximal Sharpe ratio
      2 ef = EfficientFrontier(mu, S)
----> 3 weights = ef.max_sharpe()
      4
      5 cleaned_weights = ef.clean_weights()

4 frames
/usr/local/lib/python3.6/dist-packages/pypfopt/efficient_frontier.py in max_sharpe(self, risk_free_rate)
    224         ] + new_constraints
    225
--> 226         self._solve_cvxpy_opt_problem()
    227         # Inverse-transform
    228         self.weights = (self._w.value / k.value).round(16) + 0.0

/usr/local/lib/python3.6/dist-packages/pypfopt/base_optimizer.py in _solve_cvxpy_opt_problem(self)
    222                 opt.solve(solver=self._solver, verbose=self._verbose)
    223             else:
--> 224                 opt.solve(verbose=self._verbose)
    225         except (TypeError, cp.DCPError) as e:
    226             raise exceptions.OptimizationError from e

/usr/local/lib/python3.6/dist-packages/cvxpy/problems/problem.py in solve(self, *args, **kwargs)
    288         else:
    289             solve_func = Problem._solve
--> 290         return solve_func(self, *args, **kwargs)
    291
    292     @classmethod

/usr/local/lib/python3.6/dist-packages/cvxpy/problems/problem.py in _solve(self, solver, warm_start, verbose, parallel, gp, qcp, **kwargs)
    573         full_chain = self._solving_chain.prepend(self._intermediate_chain)
    574         inverse_data = self._intermediate_inverse_data + solving_inverse_data
--> 575         self.unpack_results(solution, full_chain, inverse_data)
    576         return self.value
    577

/usr/local/lib/python3.6/dist-packages/cvxpy/problems/problem.py in unpack_results(self, solution, chain, inverse_data)
    716             raise error.SolverError(
    717                     "Solver '%s' failed. " % chain.solver.name() +
--> 718                     "Try another solver, or solve with verbose=True for more "
    719                     "information.")
    720         self.unpack(solution)

SolverError: Solver 'OSQP' failed. Try another solver, or solve with verbose=True for more information.

I have tried to run it on couple of months and with the same number of stocks and it worked ,although understandably the results were pretty high
Expected annual return: 44442507.9%
Annual volatility: 392.8%
Sharpe Ratio: 113138.39

As you suggested, maybe I will need to run this on 200 stocks at a time (with 9 years of data), keep the best performing stocks until I'll be left with 200 best stocks and run it one last time.
I am quite a beginner in code writing, but I'll try to write a loop that will do it, and if I am successful I will post here. Do you think it is possible? Any help/guidance in writing it will be greatly appreciated!
Thanks!
Ori

Hi @Originn,
Sorry if I wasn't clear: you need to increase the amount of data relative to the number of stocks.
However, I think it's a better idea to reduce the size of the stock universe first.
One way to do this (as mentioned previously) is to remove the stocks with the lowest expected returns. The below script takes the top 500 stocks (ranked by mu) from your universe.
mu = expected_returns.mean_historical_return(df)
top_stocks = mu.sort_values(ascending=False).index[:500]
df = df[top_stocks]

# Now proceed as you did before, and it _should_ be fine.
mu = expected_returns.mean_historical_return(df)
S = risk_models.sample_cov(df)
...

You can easily extend this to make it more complicated, for example, filtering by historical Sharpe ratio rather than return.
S = risk_models.sample_cov(df)
std = np.diag(S)
mu = expected_returns.mean_historical_return(df)
sharpes = mu / std
top_stocks = sharpes.sort_values(ascending=False).index[:500]
df = df[top_stocks]

The idea here, as I have mentioned in other threads (#128 , #243) is that portfolio selection is conceptually quite different to portfolio optimisation.
Hope this helps!
Robert

Hi @Originn,
Sorry if I wasn't clear: you need to increase the amount of data relative to the number of stocks.
However, I think it's a better idea to reduce the size of the stock universe first.
One way to do this (as mentioned previously) is to remove the stocks with the lowest expected returns. The below script takes the top 500 stocks (ranked by mu) from your universe.
mu = expected_returns.mean_historical_return(df)
top_stocks = mu.sort_values(ascending=False).index[:500]
df = df[top_stocks]

# Now proceed as you did before, and it _should_ be fine.
mu = expected_returns.mean_historical_return(df)
S = risk_models.sample_cov(df)
...

You can easily extend this to make it more complicated, for example, filtering by historical Sharpe ratio rather than return.
S = risk_models.sample_cov(df)
std = np.diag(S)
mu = expected_returns.mean_historical_return(df)
sharpes = mu / std
top_stocks = sharpes.sort_values(ascending=False).index[:500]
df = df[top_stocks]

The idea here, as I have mentioned in other threads (#128 , #243) is that portfolio selection is conceptually quite different to portfolio optimisation.
Hope this helps!
Robert

Thank you very much Robert it's working well.

Thank you very much Robert it's working well.

I'm glad to hear! Please feel free to raise any other issues you encounter.
Best,
Robert

I'm glad to hear! Please feel free to raise any other issues you encounter.
Best,
Robert


[Nette][2.0] move Routing from bootstrap.php to RouterFactory

Before

After

RouterFactory

Ref https://github.com/nette/sandbox/commit/2efee7ebfce4b6c278da060d25079da8a78462f0

Resolved by: #65


Lagrange Polynomial

Currently, we have a partial implementation of the lagrange interpolating polynomial for polynomials with integer coefficients (i.e. rather than over fields).  What I can't quite understand is how to construct the resulting lagrange polynomial with integer coefficients.  Apparently it can be done --- see here.

Actually, that's wrong and the stackoverflow thread illustrates it.  We can do it with rational coefficients, but that's it.


added vagrant machine status to status prompt. show ▶ and ◾

I have added the vagrant machine status to status prompt. IT will show ▶ for a running vagrant machine and ◾ for a machine that is not running.

It will look like this

Awesome, but is there a way to wrap it into a plugin?

We could add this to the existing vagrant plugin and create a prompt-function just like the battery plugin and then use it in different themes

I'd prefer to keep this out of theme and approached via a prompt function

This only works with the agnoster theme right? Powerlevel9k doesn't seem to handle it.


Update pruning tooltip, original author BitcoinErrorLog

Squashed commits from BitcoinErrorLog at his request, per the original discussion on #15: this tooltip has been adjusted to be more user-friendly and reflect what the net effect of pruning is for the user.

Thanks for the PR @fluffypony ! Can you change your PR description to describe what this change does? The maintainers' merge tool includes the PR description in the merge commit, so unless BitcoinErrorLog wants to be bombarded with notifications from github for this, you should remove his handle.

@jnewbery done

Also let me know if you want me to flip it round and put what it does at the beginning of the description, and attribution notes at the end.

Untested ACK 2fc5efc55c886f1b874ce6cd02c9082b5bb6435a

utACK 2fc5efc55c886f1b874ce6cd02c9082b5bb6435a and welcome to the dark side!

@Sjors Thanks! I was going to, but I GPG-sign my commits, so I thought it would be a little odd to have BEL as the author but with my GPG sig;)

Another approach is to put Co-Authored-By:  in the commit message (to be clear: no need to).

I think it is very important that users know pruning disables some advanced features. Otherwise, why not always enable pruning? Rerunning IBD is a hassle - currently, users are only warned that it will happen if reverted, but not why they may have to revert.

@Rspigler there's been enough bike-shedding on the previous PR; I would suggest this get merged so that feedback can be elicited from actual users, and then the tooltip can be iterated on.

Feedback already has been brought by users, this has been a requested change:
https://twitter.com/mikeinspace/status/1278453115835035653

Ehhhh I'm skeptical that users running the Bitcoin Core GUI are hooking a block explorer up to it. I agree that such warnings are warranted in the CLI and documentation. Is there any functionality within the GUI that is affected by enabling pruning? That should be noted. Some externality is (generally speaking) not the concern of this piece of software.

To add: any additional software you're trying to hook into Bitcoin will come with it's own instructions, which includes a note on disabling pruning (see Electrum Personal Server, for instance, which actually works with pruning and notes when you'd want to leave it disabled).

AFAIK, the only thing pruning disables in the GUI is the ability to close a wallet, keep it closed until the last block it saw has dropped beyond the prune horizon (plus one more block), and then open up that wallet again.  We already have a warning for that case:

(I'm not counting RPCs affected by pruning that are technically available in the GUI via its RPC console.)
I personally think it's not particularly useful to say "disables some advanced features" without also providing the user with a list of those features---and that's getting beyond the amount of information a tooltip should probably contain.  Additionally, although re-downloading blocks is certainly very annoying, anyone who did it once can probably do it again without too much issue.  I don't think we need to worry too much about it, although anyone writing extended documentation about pruning should certainly consider describing the tradeoffs.

@harding thanks for the extra colour - fully agree that extended docs should go into detail about what may be affected by pruning, and that it's out-of-scope for the tooltip.

I think that's a very good point you brought up, pruning doesn't affect functionality /within the GUI/. Warnings in the CLI and documentation should cover it.

No mention of lost functionality at all?
This impacts the ability to restore backups...

@luke-jr if you lost your original wallet file, you probably also lost your chainstate, so you probably need to IBD again anyway.

ACK 2fc5efc55c886f1b874ce6cd02c9082b5bb6435a
Since translation freeze for 0.21.0 happened already, we have to postpone this for 0.22


Add #status to Cucumber::Core::Test::Result classes

Added for https://github.com/cucumber/cucumber/issues/836

Thanks @pdswan!


Exit infite loop after closing error message

This PR fixes #19338

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 1 (0.0%)  changed or added relevant line in 1 file are covered.
1 unchanged line in 1 file lost coverage.
Overall coverage increased (+0.003%) to 42.068%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

extensions/sql-bindings/src/services/azureFunctionsService.ts
0
1
0.0%

Files with Coverage Reduction
New Missed Lines
%

src/sql/workbench/services/connection/browser/connectionDialogWidget.ts
1
75.1%

Totals

Change from base Build<PHONE_NUMBER>:
0.003%

Covered Lines:
27929

Relevant Lines:
62084

💛  - Coveralls


分类任务，关于验证集问题

在训练分类任务时，如图，我想请教下1处的数据集是哪部分数据，2处的数据集又是哪部分，为什么差别这么大，以哪个为准？

1  is train accuracy (current batch)
2 is val set accuracy @howardgriffin

1 is train accuracy (current batch) 2 is val set accuracy @howardgriffin

Thank you for your reply!
But I am confused that why the training accuracy is far lower than the validation accuracy?


Call git instead of giddy

Looks like the giddy-oops undo command is calling giddy under the hood instead of git.

Nice catch! Thanks for the pull request!

My pleasure! Thanks for the great tool!


The inability to create a custom path and name for PV.

As I can see the pvName and the pvPath to create a PV are strictly defined. However, for our purposes, a flexible solution is needed.
To decouple PV settings of NFS client (mount options, path, etc) and PVC settings it is better to put all these settings into StorageClass and makes PV-provisioner work on it.
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  namespace: kube-system
  name: managed-nfs-storage-test-2
provisioner: fuseim.pri/ifs
parameters:
  archiveOnDelete: "false"
  pathPattern: "{pvc.namespace}/{pvc.name}"
  namePattern: "{pvc.name}-{pvc.annotations.volume.beta.kubernetes.io/storage-class}"

Thanks for reporting the issue!
This repo is no longer being maintained and we are in the process of archiving this repo. Please see https://github.com/kubernetes/org/issues/1563 for more details.
If your issue relates to nfs provisioners, please create a new issue in https://github.com/kubernetes-sigs/nfs-ganesha-server-and-external-provisioner or https://github.com/kubernetes-sigs/nfs-subdir-external-provisioner.
Going to close this issue in order to archive this repo. Apologies for the churn and thanks for your patience! :pray:


Test sources end-point

Problem
One source is configured, there's no way to check if the configuration is correct except running full
synchronization cycle
Solution
Make an end-point (similar to /destinations/test) — /sources/test. End-point should accept:

Either source_id json / yaml as a body
Or source_id GET paramter

Based on input backend should test if the source is configured well and all underlying APIs are accessible.
Bonus task
/destinations/test should accept destination_id as a GET parameter as well (in addition to body) and optionally accept YAML instead of JSON. I guess the code for this one and the main task should have a somewhat common component.

Duplicate #213


Azimuth SET LUT

Checked for duplicates
Yes - I've already checked
Alternatives considered
Yes - and alternatives don't suffice
Related problems
Currently azimuth component of the SET was not being added into az_lut_data here. This will be tested by more data / cases, and will be fixed.
Describe the feature request
I need or want [...]

Closing this issue as we decided not to add the azimuth component of SET tides to the azimuth correction LUT. Analyses show that the improvement in absolute geolocation  is minimal


Are the bam files missing for some cells of the FACS data? What are the 'TK' parameters?

Hello!
I have downloaded the whole FACS data, but I met a little problem. In the paper, I noticed that there should be 110824 cells sequenced for FACS. When I sorted out all the bam files according to the provided 'tabula-muris-senis-full-metadata.csv' file, I got a total of 106273 bam files and I didn't find those missing bam files in the AWS database.
Another question is that I found a part of fastq.gz files of these missing cell files. So, I want to generate bam files using these fastq.gz files. I noticed that you used STAR v.2.5.2b with parameters TK. Can you tell me what the 'TK parameters' mean since I didn't find them in the STAR?
Thank you very much!

hi @libraryies the code used is here
unfortunately I won't be able to help further locating the files

OK, thanks for your reply.


Wait for all Armeria artifacts before sending an upgrade PR

For full automation

It worked successfully. https://github.com/line/centraldogma/actions/runs/10158380430


use nmap port interval

use nmap port interval instead of parsing argument and passing it as comma-separated string in https://github.com/srcfl/srcful-gateway/blob/main/server/web/handler/get/network.py#L46

added in https://github.com/srcfl/srcful-gateway/commit/85c38ee2bc2682d181d02afd71d1150d8d1ade35


Update cloud docs for RBE and Read Only

Description
Please include a summary of the changes and the related issue. Please also
include relevant motivation and context.
Fixes # (issue)
Type of change
Please delete options that aren't relevant.

[x] Documentation update

How Has This Been Tested?
Please also list any relevant details for your test configuration
Checklist

[x] Updated documentation if needed
[ ] Tests added/amended
[x] bazel test //...  passes locally
[x] PR is contained in a single commit, using git amend see some docs

This change is

docs/src/content/docs/nativelink-cloud/api-key.mdx line 66 at r1 (raw file):
Previously, aaronmondal (Aaron Siddhartha Mondal) wrote…
nit: Is the && ' '  part intentional?

Unfortuately yes, we tried "cleaner" implementations but Github didn't like them


Cannot join with a Query

Here is an example which triggers a pypika.utils.JoinException
order=Table("order")
product=Table("product")
subquery=Query.from_(product).select(product.id).groupby(product.id)
Query.from_(order).join(subquery).on(order.id==product.id).select("*")

The join seems to only work with Tables

Here is a quick fix:
class Subquery(Table):
    def __init__(self, query: QueryBuilder) -> None:
        self._query = query
        self._table_name = query._from[0].get_table_name()
        # Using the original table name as alias for the subquery
        # for my use case, you can use something else
        self._query.alias = self._table_name
        super().__init__(self._table_name)

    def get_sql(self, **kwargs: Any) -> str:
        return self._query.get_sql(**kwargs)
order=Table("order")
product=Table("product")
subquery=Subquery(Query.from_(product).select(product.id).groupby(product.id))
Query.from_(order).join(subquery).on(order.id==product.id).select("*")

Would you like to create a pull request?

Would you like to create a pull request?

I don't think this code is anywhere near production-ready, this is just a quick workaround I used in my facade module.
Hopefully it gives someone else ideas for a proper Subquery implementation.


Decrement the mutex use count after we've unlocked them.

Maybe/hopefully fixes #869.
/cc @srajko

This is predicated on my theory in https://github.com/nodegit/nodegit/issues/869#issuecomment-173666942 being correct. This is the simplest fix, but not as efficient as it could be. I'm not sure how much we care.

This looks good!  I'm not too worried about efficiency at this point, but that's just me.

I'm not too worried about efficiency at this point, but that's just me.

Yup, me neither :+1:

:+1:

:clap:


Added a few missing strings for Ukrainian i18n

Added some translations into Ukrainian.
Translated by myself as a native speaker.

Hey @dmmeteo! Thank you for your contributions 🙏
I believe the changes here have been covered by https://github.com/TryGhost/Ghost/pull/20709, but if I've missed anything please feel free to open a new changeset ☺


Invalid mesh data

Some models in bg/ have a 0 for MeshHeader.VertexDataPartCount, indicating they have no vertex data at all, leading to an exception when attempting to read vertices.
Example file keys (using IndexSource)

0xF6C42306
0xF1A253D6

Now have a filename of a problematic file bg/ffxiv/wil_w1/bah/common/bgparts/w1b1_b4_holm5.mdl, could probably find more.


Add impl stage-testing cmd

Add call jenkins stage pipe job func.
next will confirm it added to which part, after all advisorifes push to cdn stage success to call it  or just wait metadata advisory push to cdn stage finish, then call it?

@rioliu-rh Updated according comments, please review it again, thanks

@rioliu-rh tested in local, it can trigger stage job and update Stage testing to in progress
[wewang@fedora release-tests]$ python cli  -r 4.13.2 stage-testing
2023-06-08T10:56:30Z: ERROR: handle_other(): Mutual authentication failed
2023-06-08T10:56:33Z: INFO: triggerred stage pipeline job: https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/zstreams/job/Stage-Pipeline/702
2023-06-08T10:56:34Z: INFO: task [Stage testing] status is changed to [In Progress]
[wewang@fedora release-tests]$ python cli  -r 4.13.2 stage-testing
2023-06-08T11:03:32Z: ERROR: handle_other(): Mutual authentication failed
2023-06-08T11:03:36Z: INFO: triggerred stage pipeline job: https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/zstreams/job/Stage-Pipeline/703
2023-06-08T11:03:37Z: INFO: task [Stage testing] status is changed to [In Progress]
about "ERROR: handle_other(): Mutual authentication failed", it's python jenkins related bug, the bug is still new: https://bugs.launchpad.net/python-jenkins/+bug/1849302

@rioliu-rh tested in local, it can trigger stage job and update "Stage testing" in report to "in progress"
[wewang@fedora release-tests]$ python cli -r 4.13.2 stage-testing 2023-06-08T11:03:32Z: ERROR: handle_other(): Mutual authentication failed 2023-06-08T11:03:36Z: INFO: triggerred stage pipeline job: mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/zstreams/job/Stage-Pipeline/703 2023-06-08T11:03:37Z: INFO: task [Stage testing] status is changed to [In Progress]
about "ERROR: handle_other(): Mutual authentication failed", it's python jenkins related bug, the bug is still new: bugs.launchpad.net/python-jenkins/+bug/1849302, it just give the error info, not affect connect to jenkins.

Can we send out the job url via slack

about "ERROR: handle_other(): Mutual authentication failed", it's python jenkins related bug, the bug is still new: bugs.launchpad.net/python-jenkins/+bug/1849302, it just give the error info, not affect connect to jenkins.

you can disable logger of jenkins lib

about "ERROR: handle_other(): Mutual authentication failed", it's python jenkins related bug, the bug is still new: bugs.launchpad.net/python-jenkins/+bug/1849302, it just give the error info, not affect connect to jenkins.

you can disable logger of jenkins lib

about "ERROR: handle_other(): Mutual authentication failed", it's python jenkins related bug, the bug is still new: bugs.launchpad.net/python-jenkins/+bug/1849302, it just give the error info, not affect connect to jenkins.

you can disable logger of jenkins lib

sorry, you mean disable logger of jenkins_helper module, right? i did that, but still have the error info

Add new cmds:image-consistency-check and image-signed-check cmds and get job status via job id:
[wewang@fedora release-tests]$ python cli -r 4.13.2 image-consistency-check
2023-06-13T09:18:13Z: INFO: job id is not set, will trigger image consistency check job
2023-06-13T09:18:17Z: ERROR: handle_other(): Mutual authentication failed
2023-06-13T09:18:20Z: INFO: triggerred image consistency check job: https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/image-consistency-check/2229
2023-06-13T09:18:21Z: INFO: task [Payload-Images Consistency Testing] status is changed to [In Progress]
[wewang@fedora release-tests]$ python cli -r 4.13.2 image-signed-check
2023-06-13T09:19:53Z: ERROR: handle_other(): Mutual authentication failed
2023-06-13T09:19:56Z: INFO: triggerred signature_check job: https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/zstreams/job/signature_check/137
2023-06-13T09:19:57Z: INFO: sent slack message to <#test-wewang>
2023-06-13T09:19:58Z: INFO: task [Payload image is well signed] status is changed to [In Progress]
[wewang@fedora release-tests]$ python cli -r 4.13.2 image-consistency-check -n 2229
2023-06-13T09:47:13Z: INFO: check image consistency check job status according  to job id:2229
2023-06-13T09:47:14Z: ERROR: handle_other(): Mutual authentication failed
2023-06-13T09:47:17Z: INFO: image-consistency-check job: 2229 status is: ABORTED
about jenkins error info, still need to time to check, will submit a new pr to fix it.

/lgtm

/lgtm


[ER-459] Add crypto2 to the Erlang load path in FIPS mode

This templatizes vm.args to include the crypot2 module at the front of the load path if FIPS mode is enabled. This means that after adding fips true to chef-server.rb and reconfiguring, the Erlang app will be using the crypto2 module to access the OpenSSL FIPS module.
We include the erlang-crypto2 module in all omnibus distributions, but users chose to activate it at runtime.

[x] Manual testing to make sure this works
[x] Update the other Erlang modules to use a similar pattern

I need to test this some more and see if there are any tests I can add/update, but I would love to start getting eyes on this.  /cc @chef/chef-server-maintainers

@stevendanna Updated per your comments!

Pedant tests passed with a local build

Since we're moving the vm.args files [back] into templates, let's also remove them from their original locations in $project/config/vm.args, and the overlay references in $project/rebar.config

@marcparadise There is still $project/config/sys.config even though those are templatized. I thought the local copies of sys.config and vm.args were used for local testing?

@marcparadise I had to restore the vm.args for the oc_bifrost application. Without this file present in the root of the release, the bin/oc_bifrost start command loads vm.args and sys.config from releases/12.12.0-blah/. Those files are defaulted / empty so they are missing necessary config values to run.
Restoring vm.args to the root of the release dir causes the bin/oc_bifrost start to load vm.args and sys.config from the root dir. This sys.config has the correct configurations needed and the applicaiton starts.
It looks like the bin/oc_bifrost command is generated by rebar (or relx) so I could not change that. Instead I opted to restore the vm.args file that I had deleted.


Add transition when opening and closing sidebar

sidebar.webm

Hey, good job! Can you reach me on Telegram: https://t.me/ArtemSBulgakov

This PR closes #39

Looks good on https://pre.innohassle.ru, will publish to production today


GEOMESA-3341 Update to arrow 15.0.1

seems like the 15.0.1 release didn't actually include the intended fixes, so they are working on a 15.0.2 - we'll wait for that.


Capistrano Deploy Rollbar Comment Fix

The Issue:

When deploying with capistrano the rollbar_comment is not passed
through to Rollbar::Update during a report_deploy_succeeded or a report_deploy_failed

The Fix:

Added :comment => capistrano.fetch(:rollbar_comment) to the
report_deploy_succeeded and report_deploy_failed tasks

@zoiec Thank you for the PR.


Replace --use with --enter

Signed-off-by: Mike Spreitzer<EMAIL_ADDRESS>
Summary
This PR updates the outdated command line flag cited in #1189 .
Related issue(s)
Fixes #1189

/ok-to-test


Solve the problem of 0 views

I need to discuss this issue to find a solution. Currently, I have two newly created accounts.

Account 1: I manually upload videos using Firefox Portable and it has viewers, specifically 500 views.
Account 2: I upload videos automatically using Chrome and it has no viewers, with 0 views.

I am currently suspecting that TikTok might have detected duplicate profiles between the browsers. Has anyone else experienced this issue? Please suggest possible solutions to resolve this problem.

Same here

At the moment the "Solution" that I have found is to run an account on each VM, but surely there is a more practical method.

At the moment the "Solution" that I have found is to run an account on each VM, but surely there is a more practical method.

If you apply this method, how many video views will there be?

At the moment the "Solution" that I have found is to run an account on each VM, but surely there is a more practical method.

If you apply this method, how many video views will there be?

It depends on each account. But all above 300. By the way, I saw in a PR that you were able to solve the schedule, is it still working for you?

At the moment the "Solution" that I have found is to run an account on each VM, but surely there is a more practical method.

If you apply this method, how many video views will there be?

It depends on each account. But all above 300. By the way, I saw in a PR that you were able to solve the schedule, is it still working for you?

I have scheduled a fixed schedule, but the number of views is still 0 views

Could you give me the scripts that you modified so that the schedule works for you?

Could you give me the scripts that you modified so that the schedule works for you?

try:
try:
# Thực hiện tìm kiếm và kích hoạt radio button bằng cách sử dụng selector
radio_button = driver.find_element(By.CSS_SELECTOR, config['selectors']['schedule']['radio_button'])
radio_button.click()
except NoSuchElementException:
# Xử lý nếu không tìm thấy phần tử
switch = driver.find_element(By.XPATH, config['selectors']['schedule']['switch'])
switch.click()
__date_picker(driver, month, day)
__time_picker(driver, hour, minute)
except Exception as e:
msg = f'Lỗi đặt lịch đăng: {e}'
logger.error(red(msg))
raise FailedToUpload()

That's in the config.toml right?

check shadow ban


Edit a student's information

As a TA, I can edit a student's information so that I can fix any errors i made during the initial adding phase or add information that was not provided to me before.

Fixed by #45 #49 #50 #52


Non blocker

Signed-off-by: Amit Galitzky<EMAIL_ADDRESS>Description
This PR integrates the new additional type parameter for validation API that includes model validation. Since model (non-blocker) validation also runs detector (blocker) validation, currently I only call the validate API with model parameter. In the future we can separate the two if we want to make the non-blocker validation an optional action. With this API integrated the user will be able to see any non-blocking issues.
Changes include:

If response type is model then object passed to model or detector definition will include that information and the callout will be of color warning instead of danger

Screenshot:

Check List

[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

Merging #202 (506e146) into main (53a0f4f) will decrease coverage by 0.03%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main     #202      +/-   ##
==========================================
- Coverage   45.93%   45.90%   -0.04%
==========================================
  Files         150      150
  Lines        4944     4956      +12
  Branches      951      955       +4
==========================================
+ Hits         2271     2275       +4
- Misses       2455     2463       +8
  Partials      218      218

Impacted Files
Coverage Δ

...ges/ReviewAndCreate/containers/ReviewAndCreate.tsx
39.53% <0.00%> (-2.24%)
:arrow_down:

...ectorDefinitionFields/DetectorDefinitionFields.tsx
68.42% <0.00%> (-2.17%)
:arrow_down:

...in/public/pages/DefineDetector/utils/constants.tsx
100.00% <0.00%> (ø)

...elConfigurationFields/ModelConfigurationFields.tsx
44.11% <0.00%> (+0.17%)
:arrow_up:

...tion-dashboards-plugin/public/redux/reducers/ad.ts
57.50% <0.00%> (+0.35%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 53a0f4f...506e146. Read the comment docs.

Let's wait for the backend PR to merge before merging this one.


Test is not terminating

Hi,
I have started a test with configuration:
1 agent, 1 process and 10 threads with,ramp-up(incremental step: 1 and interval: 1000ms)
that test is not terminating, even if i manually tried to stop test.
Does anybody have an idea how can i stop it?
Thanks,
Shital

@shital1223
Is any logs in controller?

@donggyu04
below is the error logs (when i click on status):
Console is being prepared.
Console is started on port 12001
1 agents are starting.
1 agents are ready.
All necessary files are being distributed.
The total size of distributed files is over 976.6KBB.

Safe file distribution mode is enabled by force.
TestRunner.groovy
resource1.txt
lib/httpclient-4.5.8.jar
lib/commons-logging-1.2.jar
lib/httpcore-4.4.11.jar
lib/commons-codec-1.11.jar
All necessary files are distributed.
The test is ready to start.
The test is started.

Script error
2019-07-16 04:38:46
Thanks,
Shital

@donggyu04
Detailed log:
[
{
"testName": "communicationLibwith10Threads",
"tagString": "",
"description": "",
"status": "ABNORMAL_TESTING",
"ignoreSampleCount": 0,
"startTime": "Jul 16, 2019 4:39:18 AM",
"targetHosts": "",
"useRampUp": true,
"rampUpType": "THREAD",
"threshold": "R",
"scriptName": "commWithContext/src/main/java/TestRunner.groovy",
"duration": 60000,
"runCount": 1,
"agentCount": 1,
"vuserPerAgent": 10,
"processes": 1,
"rampUpInitCount": 0,
"rampUpInitSleepTime": 0,
"rampUpStep": 1,
"rampUpIncrementInterval": 1000,
"threads": 10,
"testErrorCause": "TESTING",
"progressMessage": "\nConsole is being prepared.\nConsole is started on port 12001\n1 agents are starting.\n1 agents are ready.\nAll necessary files are being distributed.\nThe total size of distributed files is over 976.6KBB.\n- Safe file distribution mode is enabled by force.\n - TestRunner.groovy\n - resource1.txt\n - lib/httpclient-4.5.8.jar\n - lib/commons-logging-1.2.jar\n - lib/httpcore-4.4.11.jar\n - lib/commons-codec-1.11.jar\nAll necessary files are distributed.\nThe test is ready to start.\nThe test is started.\n",
"testComment": "",
"scriptRevision": 329,
"stopRequest": true,
"region": "NONE",
"samplingInterval": 2,
"param": "",
"createdDate": "Jul 16, 2019 4:38:46 AM",
"lastModifiedDate": "Jul 16, 2019 4:38:46 AM",
"id": 1775
}
]
Thanks,
Shital

@shital1223
Is this still happened?
and then, Safe file distribution mode is enabled by force.
file distribution to the agent is slow when enable safe file distribution mode.
this means that the test start time is delayed a lot.
you can modify ngrinder system configuration controller.safe_dist_threshold value big enough.
could you run using duration threshold? (not use runCount)

Hi @donggyu04
The issue is resolved now. our central team who has provisioned Ngrinder instance deleted that test.
Though when that test was running(infinitely) I was not able to start any test.
so how can I run new test for duration threshold ?
Also i want to run script which i created with groovy-maven  structure project, and it has other libraries like apache http client etc.  so i guess in order to process it by ngrinder i need to configure :
controller.safe_dist_threshold as suggested by you.
please correct me if have have assumed something wrong. and how can i configure this variable?
Thanks,
Shital

@shital1223
If you access admin account you can modify ngrinder System Configuration at this menu.

duration threshold means that this.


.NET 3.5 support

This is a feature request for .NET 3.5 support so that Couchbase Lite can use this library without compiling it ourselves.  There is very minimal work that needs to be done for source changes (they are all included in the first commit of my SQLCipher PR).  The majority of the work comes from generating a .NET 3.5 target for raw and ugly.  Please let me know if this is a possibility.

Indeed.
Unless I find a good reason not to, I would like to do this.
BTW, so sorry I have been dragging my feet on merging your sqlcipher PR.  I am gearing up for a round of work on SQLitePCL.raw here, and I hope to get my work queue largely cleared out.  :-)

Version 0.8.5-pre3 is in nuget and contains support for net35.  Did I get it right?  :-)

0.8.5, with net35 support, has been pushed up to nuget.  closing this issue.  feel free to reopen or log a new one if something isn't working right.


Try fixing YAML syntax

Trying again to fix broken YAML syntax and make deploy work.

@jonmv This should hopefully work. Please review and merge.


How about do the producer set max.request.size in application.properties?

just like spring.kafka.bootstrap-servers=**** or spring.kafka.producer.key-serializer=org.apache.kafka.common.serialization.ByteArraySerializer

Please don't use GitHub issues to ask questions; use Stack Overflow or Gitter for that; issues are to report bugs or ask for new features.
See the boot documentation about setting arbitrary kafka properties.
spring.kafka.producer.properties.max.request.size=

thanks


Problems with ngc builds of external dependency

Hi,
I'm using applicationinsights as a dependency for an angular library I'm creating.
I'm using applicationinsights 1.0.4 and the typings v1.0.4.
I'm using applicationinsights in a service like this (typescript file):
import { AppInsights } from 'applicationinsights-js';
However when the compiler converts it to an es2015 module, the import becomes:
import { AppInsights } from 'applicationinsights-js/index';
(note the extra: /index at the end)
which is obviously wrong and breaks. Any ideas why this is occuring? I feel like it's something to do with the way the @types works but can't work out why.
Here's a sample of the tsconfig I'm using (tsconfig.es5.json)
{
  "extends": "./tsconfig.lib.json",
  "compilerOptions": {
    "target": "es5",
    "outDir": "../../out-tsc/lib-es5/",
    "baseUrl": "",
    "typeRoots": [

      "../../node_modules/@types/"
    ],
    "types": ["applicationinsights-js"]
  },
  "files": [
    "./index.ts",
    "./typings.d.ts"
  ],
  "angularCompilerOptions": {
    "annotateForClosureCompiler": true,
    "strictMetadataEmit": true,
    "skipTemplateCodegen": true,
    "flatModuleOutFile": "logging-ng.js",
    "flatModuleId": "logging-ng",
    "genDir": "../../out-tsc/lib-gen-dir/"
  }
}

Note that I added types and typeroots but it doesn't seem to make any difference.
Thanks for your time
Leander

this seems to be the same as #50

I had similar problem with importing uirouter/angular-hybrid. Try adding paths object to rollupBaseConfig object in build.js file located in root of library, i.e.
const rollupBaseConfig = {
   moduleName: camelCase(libName),
   sourceMap: true,
   globals: {
     '@angular/core': 'ng.core'
   },
   external: [
     '@angular/core'
   ],
   paths: {
     'applicationinsights-js/index': 'applicationinsights-js'
   },
   plugins: [
     sourcemaps()
   ]
 };

My similar problem in issue #50 was solved, by adding _paths: { 'xxx/index': 'xxx' } in rollup config.
Thank you @adamlubek for this.


'Invoke an API Secured with Mutual SSL from the Developer Portal' section is missing.

Description:
The section 'Invoke an API Secured with Mutual SSL from the Developer Portal' is missing from the document.[1]
[1] https://apim.docs.wso2.com/en/latest/learn/api-security/api-authentication/secure-apis-using-mutual-ssl/#SecuringAPIswithMutualSSL-InvokeanAPIsecuredwithMutualSSLfromtheDeveloperPortal

@msm1992 , in commit [1] you have removed the "Invoke an API Secured with Mutual SSL from the Developer Portal' section. Can you please clarify whether we need to add this section back.
[1] https://github.com/wso2/docs-apim/commit/d0d898187ff938e43c6480ff713eed7d3e2f49a0

Since the instructions brought forward from the previous versions did not work as instructed, we decided to remove it from the doc and add the postman based approach as the try out method in the 3.1.0 doc.
If we need to add the removed section again, then we need to revise the steps.

This cannot be done via the dev portal. Hence as a solution the invoking using postman has been introduced.


Open preview in new window

Make this preview button match the other Preview/Draft/Live buttons in admin UI

Merged in b817e869bf254a5be94b684336dd980856b86c4d - thanks @cnk!


Added id attribute for images

id attribute was missing, So I added a support for it.

Hi @varun-raj. Thanks for your contribution. I'm curious why you modified the .npmignore and the .gitignore and added the lib folder to this repo?

I'm not sure attributes like id have a place in semantic markup. But I'd like to allow custom attributes like this using an option. I'll followup with an alternative approach.


Check failed: sign == true (0 vs. 1) when loading DMatrix from binary file

Hi,
I am attempting to write a loaded DMatrix into a binary buffer file and then reload the data from that same file. This same code actually works fine in a notebook and is shown in several xgboost example docs, but strangely I see a bug when trying to do the same in my production script (the only thing that is different is I am distributing the training with rabit tracker, but don't think that should affect this...). I am using xgboost version 1.6.0.
Sample script:
with tempfile.TemporaryDirectory() as local_write_path:
    tmp_dm = xgb.DMatrix(data=x, label=y)
    out_filepath = os.path.join(local_write_path, f'rank_{rank}.binary')
    tmp_dm.save_binary(out_filepath)
    del tmp_dm

    logging.info("test loading dmatrix from binary")
    tmp_dm_2 = xgb.DMatrix(out_filepath)
    logging.info("success")

During the line tmp_dm_2 = xgb.DMatrix(out_filepath) I get the following dmlc parser error:
File "/usr/local/lib/python3.8/site-packages/xgboost/core.py", line 532, in inner_f
    return f(**kwargs)
  File "/usr/local/lib/python3.8/site-packages/xgboost/core.py", line 643, in __init__
    handle, feature_names, feature_types = dispatch_data_backend(
  File "/usr/local/lib/python3.8/site-packages/xgboost/data.py", line 890, in dispatch_data_backend
    return _from_uri(data, missing, feature_names, feature_types)
  File "/usr/local/lib/python3.8/site-packages/xgboost/data.py", line 805, in _from_uri
    _check_call(_LIB.XGDMatrixCreateFromFile(c_str(data),
  File "/usr/local/lib/python3.8/site-packages/xgboost/core.py", line 203, in _check_call
    raise XGBoostError(py_str(_LIB.XGBGetLastError()))
xgboost.core.XGBoostError: [22:44:12] ../src/data/data.cc:913: Encountered parser error:
[22:44:12] ../dmlc-core/include/dmlc/threadediter.h:500: [22:44:12] ../dmlc-core/include/dmlc/./././strtonum.h:398: Check failed: sign == true (0 vs. 1) :
Stack trace:
  [bt] (0) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x6be3b9) [0x7fe8c064a3b9]
  [bt] (1) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x6c5ecf) [0x7fe8c0651ecf]
  [bt] (2) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x6f9fbc) [0x7fe8c0685fbc]
  [bt] (3) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(std::thread::_State_impl<std::thread::_Invoker<std::tuple<dmlc::data::TextParserBase<unsigned int, float>::FillData(std::vector<dmlc::data::RowBlockContainer<unsigned int, float>, std::allocator<dmlc::data::RowBlockContainer<unsigned int, float> > >*)::{lambda()#1}> > >::_M_run()+0x15d) [0x7fe8c065014d]
  [bt] (4) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x78c5cf) [0x7fe8c07185cf]
  [bt] (5) /lib/x86_64-linux-gnu/libpthread.so.0(+0x7fa3) [0x7fea0a9e2fa3]
  [bt] (6) /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f) [0x7fea0a784eff]

Stack trace:
  [bt] (0) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x6be3b9) [0x7fe8c064a3b9]
  [bt] (1) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x6ed0b9) [0x7fe8c06790b9]
  [bt] (2) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x6ed27b) [0x7fe8c067927b]
  [bt] (3) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x1adc5d) [0x7fe8c0139c5d]
  [bt] (4) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x16a455) [0x7fe8c00f6455]
  [bt] (5) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x15a30d) [0x7fe8c00e630d]
  [bt] (6) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(XGDMatrixCreateFromFile+0xd2) [0x7fe8c003d8e2]
  [bt] (7) /usr/lib/x86_64-linux-gnu/libffi.so.6(ffi_call_unix64+0x4c) [0x7fea09fbe8ee]
  [bt] (8) /usr/lib/x86_64-linux-gnu/libffi.so.6(ffi_call+0x22f) [0x7fea09fbe2bf]

Stack trace:
  [bt] (0) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x154c79) [0x7fe8c00e0c79]
  [bt] (1) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(+0x6df25) [0x7fe8bfff9f25]
  [bt] (2) /usr/local/lib/python3.8/site-packages/xgboost/lib/libxgboost.so(XGDMatrixCreateFromFile+0xd2) [0x7fe8c003d8e2]
  [bt] (3) /usr/lib/x86_64-linux-gnu/libffi.so.6(ffi_call_unix64+0x4c) [0x7fea09fbe8ee]
  [bt] (4) /usr/lib/x86_64-linux-gnu/libffi.so.6(ffi_call+0x22f) [0x7fea09fbe2bf]
  [bt] (5) /usr/local/lib/python3.8/lib-dynload/_ctypes.cpython-38-x86_64-linux-gnu.so(_ctypes_callproc+0x75f) [0x7fea09fd5c6f]
  [bt] (6) /usr/local/lib/python3.8/lib-dynload/_ctypes.cpython-38-x86_64-linux-gnu.so(+0x900b) [0x7fea09fcb00b]
  [bt] (7) /usr/local/lib/libpython3.8.so.1.0(_PyObject_MakeTpCall+0x84) [0x7fea0ab5e5d4]
  [bt] (8) /usr/local/lib/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x4e27) [0x7fea0abdd7e7]

It seems the key line is strtonum.h:398: Check failed: sign == true (0 vs. 1). Any ideas what might be going wrong here?

Scanning through the source code it looks like this problem is due to rabit, since DMatrix only tries to load a binary file if the nparts = 1. It looks like rabit wants to handle the data sharding, but I'm looking to handle this manually. Is there a way from the python API to disable load_row_split or can we track a feature request to expose this in the python DMatrix API?
https://github.com/dmlc/xgboost/blob/2c70751d1ed9d51e1108457ae216027883993845/src/data/data.cc#L843-L863

Thank you for raising the issue. I will look into this.

Thanks for the quick fix @trivialfis!


Internal Server Error when trying to display 2+ days history of 10+ hosts

I'm trying to work out if this is a bug with the plugin/Grafana, or it's simply a limitation of how much data I'm trying to pull.
Let's say I want a table showing average CPU utilization of a server over the past 7 days.

No problem, I'm able to select the select a single host, a relevant application and item, set the table to time series aggregation,  and set the time range to 7 days. I have my data;

Now let's say I want to do the same for a small group of servers.

Again, no problem, I choose a group with, say 8 servers in it, keep the rest of the settings the same as previous, and I have my data;

Now let's say I want to display the same data for all of my servers, or a larger group.
This is where my problem lies.

I make the change to target a larger group, or  I use /.*/ for group and hosts, to target everything
I get 'No data to show', along with a red 'internal server error' at the top left of the widget
If I go ahead and change the time picker to 'Last 12 hours', it works, my data appears
If I then go ahead and change the time picker to 'Last 24 hours', or above, it bombs out;

Does this sound familiar to anyone? Is there a way around it?
Because Zabbix doesn't really have a reporting facility, I want to use Grafana to produce monthly over/undersubscription reports - but as it stands, it's only really going to be useful for live dashboards of recent data.
Thanks for your help! I love your plugin. I would not have been able to sell the Grafana/Zabbix idea without it!
Grafana Version: 6.5.2
Zabbix Version: 4.4.4
Zabbix-Grafana Plugin Version: 3.10.5

I have similar issue, but zabbix is working stable (I have plenty of memory allocated for PHP).
I have OOM errors on alexanderzobnin-zabbix-app plugin. Memory usage incdeasing to ~500MB when asking for 20-30 hosts - if time picker is set to > 12h.


Include support for GeoIMC algorithm

Description
Add GeoIMC algorithm. Checkout 00_quick_start/geoimc_movielens.ipynb for a quick overview.
Related Issues

Checklist:

[x] I have followed the contribution guidelines and code style for this project.
[x] I have added tests covering my contributions.
[x] I have updated the documentation accordingly.
[x] This PR is being made to staging and not master.

hey another comment, I was looking the other day at the algo Pratik and Bamdev did RLRMC, which I really liked. It doesn't have a ranking method (like recommend_k_items). Out of curiosity, for GeoIMC or even for RLRMC, is it possible to have a ranking method? is mathematically sound to do it?
FYI @pratikjawanpuria @bamdevm

hey another comment, I was looking the other day at the algo Pratik and Bamdev did RLRMC, which I really liked. It doesn't have a ranking method (like recommend_k_items). Out of curiosity, for GeoIMC or even for RLRMC, is it possible to have a ranking method? is mathematically sound to do it?
FYI @pratikjawanpuria @bamdevm

Yes Miguel, it should be possible to have such a ranking method. Thanks for the input. We will include it in GeoIMC and also add it in RLRMC.

(sorry I pressed "close and comment" by mistake)

hey @SatyadevNtv, this is really good. Just one final ask, people normally add tests to make sure that everything works. Here you can read more about it: https://github.com/microsoft/recommenders/tree/master/tests
Would it be possible to add unit tests for the code and an integration test for the notebook?

hey @SatyadevNtv, this is really good. Just one final ask, people normally add tests to make sure that everything works. Here you can read more about it: https://github.com/microsoft/recommenders/tree/master/tests
Would it be possible to add unit tests for the code and an integration test for the notebook?

Yes. It should be.
I will include them.
Thanks.

hey @SatyadevNtv, this is really good. Just one final ask, people normally add tests to make sure that everything works. Here you can read more about it: https://github.com/microsoft/recommenders/tree/master/tests
Would it be possible to add unit tests for the code and an integration test for the notebook?

Included them at 6a3a5aa0bbfe79536c254bed4a7e77ecbb20c1d3

hey @SatyadevNtv, thanks for the contribution, feel free to add your name in authors if you wish https://github.com/Microsoft/Recommenders/wiki/How-to-add-your-name-as-a-contributor-to-the-repo#add-your-name-in-authorsmd


?debug parameter won't work

First example can be viewed on http://localhost:8000/Counter.elm for me, but navigating to http://localhost:8000/Counter.elm?debug will return this to me
Failed to load resource: the server responded with a status of 500 (Internal Server Error)
Uncaught TypeError: Elm.fullscreenDebug is not a function

Do I need to install something else? I'm running this with Elm Reactor 0.3.1 (Elm Platform 0.15).
I'm opening this issue because README.md of this repository is linking to http://localhost:8000/Counter.elm?debug.

Can confirm... It looks like the debug script isn't included in the html file...? which I don't believe exists in this tutorial but then again I don't know how to elm yet...

This was happening to me as well, and then I tried it a couple of minutes later and it was suddenly working. It was giving me some kind of error about downloading packages, so maybe elm-reactor was silently updating some packages in the background?

I also experienced this behavior (see #35) and is was the result of not properly including the location of the Reactor files.  I use Linux, installing node/npm via nvm so I had to set the  ELM_HOME env var correctly.
It seems that elm-reactor injects files into the project at run time and sources these files from ELM_HOME, but I could easily be wrong about that.

Same issue here, and setting ELM_HOME environment variable fixed the problem.

It looks like this is the same ELM_HOME issue as reported to the folks who created the npm installer so I am going to close it here.


chore: release v0.3.5

:robot: I have created a release beep boop
0.3.5 (2024-07-28)
Performance Improvements

render optimizations (#82) (652fd90)

This PR was generated with Release Please. See documentation.

:robot: Created releases:

v0.3.5
:sunflower:


indexers/flatutreexoproofindex: Initial Multi-block proof

Implement initial multi-block proof support.  The flatutreexoproofindex
behaves the same as before and the new code is not used during ibd.
There's no guarantee that the multiblockproof is correct.  Currently it
syncs ok but there isn't code where the CSNs use the proof.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

38 of 185 (20.54%)  changed or added relevant lines in 6 files are covered.
7 unchanged lines in 3 files lost coverage.
Overall coverage decreased (-0.1%) to 54.444%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

server.go
0
5
0.0%

wire/udata.go
0
5
0.0%

blockchain/utreexoviewpoint.go
0
6
0.0%

blockchain/chainio.go
0
12
0.0%

blockchain/indexers/flatutreexoproofindex.go
37
156
23.72%

Files with Coverage Reduction
New Missed Lines
%

mempool/mempool.go
1
63.87%

blockchain/indexers/flatutreexoproofindex.go
3
46.8%

peer/peer.go
3
75.37%

Totals

Change from base Build<PHONE_NUMBER>:
-0.1%

Covered Lines:
26235

Relevant Lines:
48187

💛  - Coveralls


[WIP] re-implement beam search on top of vllm core

submitting the pr draft on behalf of @lunreclipse .

Have you measured the performance?

Have you measured the performance?

not yet, waiting for gpus to test.

the command I use to benchmark:
python benchmarks/benchmark_throughput.py --input-len 256 --output-len 256 --model meta-llama/Meta-Llama-3-8B --use-beam-search --n 4 --num-prompts 100
the machine is H100 DGX, and I use one GPU to run the benchmark.
main branch:
Throughput: 0.61 requests/s, 310.62 tokens/s
this branch
turn on use_new_beam_search = True in the benchmark script
Throughput: 0.10 requests/s, 51.55 tokens/s
this branch + prefix caching
add --enable-prefix-caching --use-v2-block-manager
python benchmarks/benchmark_throughput.py --input-len 256 --output-len 256 --model meta-llama/Meta-Llama-3-8B --use-beam-search --n 4 --num-prompts 100 --enable-prefix-caching --use-v2-block-manager
Throughput: 1.08 requests/s, 551.83 tokens/s
this branch + prefix caching (with block size 1)
flash attention and xformers do not support block size 1.
it looks pretty exciting that using this branch and prefix caching is much faster than the main branch.

cc @WoosukKwon @zhuohan123 @simon-mo  for final decision.
and cc @hrsmanian @zhouyuan @lanking520 @nightflight-dk @HeegonJin @SemMulder @darabos @DhruvaBansal00 @tmostak @physicsrob @YooSungHyun @denadai2 @sjmielke @Reichenbachian @AaronFriel @hinnefe2 @mflaxman10 for community feedback ( and especially community contribution!)


puredata: 0.50-2 -> 0.52-1

It looks like the old source location is offline and has been moved. See
the new src URL.
Personally this fixes an issue where puredata's JACK backend segfaulted
on the long device name created by pipewire-jack.
https://github.com/pure-data/pure-data/pull/1294

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

cc @cillianderoiste

This appears to break gem for me, nixos x86_64:
Event.cpp: In function 'void dequeueEvents()':
Event.cpp:353:5: error: 'error' was not declared in this scope; did you mean 'perror'?
  353 |     error("dequeue NULL queue");
      |     ^~~~~
      |     perror
Event.cpp:358:5: error: 'error' was not declared in this scope; did you mean 'perror'?
  358 |     error("dequeue empty queue");
      |     ^~~~~
      |     perror

Also cyclone
builder for '/nix/store/r3q5zszbl5ld4c3lcla7frbc7rbs0d5l-cyclone-0.3beta-2.drv' failed with exit code 2; last 10 log lines:
        |         ^
  cyclone_src/binaries/control/grab.c: In function 'grab_setup':
  cyclone_src/binaries/control/grab.c:251:31: warning: cast between incompatible function types from 'void * (*)(t_symbol *, t_floatarg)' {aka 'void * (*)(struct _symbol *, float)'} to 'void * (*)(void)' [8;;https://gcc.gnu.org/onlinedocs/gcc/Warning-Options.html#index-Wcast-function-type-Wcast-function-type8;;]
    251 |     grab_class = class_new(s, (t_newmethod)grab_new,
        |                               ^
  cyclone_src/binaries/control/grab.c:271:6: warning: implicit declaration of function 'error'; did you mean 'perror'? [8;;https://gcc.gnu.org/onlinedocs/gcc/Warning-Options.html#index-Wimplicit-function-declaration-Wimplicit-function-declaration8;;]
    271 |      error("grab: failure to initialize remote grabbing feature");
        |      ^~~~~
        |      perror
  make: *** [pd-lib-builder/Makefile.pdlibbuilder:861: cyclone_src/binaries/control/grab.o] Error 1

@risicle ahh, are these pinned to an old version of pd something along these lines?

Afraid I don't know much about pd packaging in nixpkgs - you'll need to go digging I expect.

Closing in favour of  #230569.


Break cyclic dependencies of CMake targets

There seem to be several cycles in the dependency graph of CMake targets. This isn't a problem for compiling static libraries, but if I build with cmake -DBUILD_SHARED_LIBS=ON ..., I get the following error (uninteresting parts omitted):
CMake Error: The inter-target dependency graph contains the following strongly connected component (cycle):
  "substrait_io" of type STATIC_LIBRARY
    depends on "substrait_textplan_converter" (weak)
    depends on "symbol_table" (weak)
    depends on "substrait_textplan_loader" (weak)
    depends on "substrait_textplan_converter" (strong)
    depends on "substrait_textplan_loader" (strong)
  "symbol_table" of type SHARED_LIBRARY
    depends on "substrait_textplan_converter" (weak)
    depends on "substrait_io" (weak)
    depends on "substrait_textplan_loader" (weak)
  "substrait_textplan_converter" of type SHARED_LIBRARY
    depends on "substrait_io" (weak)
    depends on "substrait_textplan_loader" (weak)
    depends on "symbol_table" (weak)
  "substrait_textplan_loader" of type SHARED_LIBRARY
    depends on "symbol_table" (weak)
    depends on "substrait_textplan_converter" (weak)
    depends on "substrait_io" (weak)
At least one of these targets is not a STATIC_LIBRARY.  Cyclic dependencies are allowed only among static libraries.

I understand that there are reasons not to build shared libraries, but I argue that there are situations where it is useful. (I am working on a project with many top-level binaries that share 99% of the code and compilation and disk usage is a lot better with shared libs, so I hugely prefer that for developing and CI.)
I am currently trying to consume substrait-cpp as a dependency using add_subdirectory. Since I build my top-level project with BUILD_SHARED_LIBS, substrait-cpp is built with the same configuration. For any scenario where that flag is desired or required for the top-level project, support that flag would be great.
Finally, I believe that cyclic dependencies are often an indication for sloppy design or code organization and therefor a good idea to clean up. However, I haven't looked into the cycles yet, so I don't know yet whether there are good reasons to have them or things have just grown this way...

OK, one cycle can be broken very easily:
diff --git a/src/substrait/textplan/converter/CMakeLists.txt b/src/substrait/textplan/converter/CMakeLists.txt
index 5ee2753..f328f81 100644
--- a/src/substrait/textplan/converter/CMakeLists.txt
+++ b/src/substrait/textplan/converter/CMakeLists.txt
@@ -24,7 +24,6 @@ target_link_libraries(
   substrait_textplan_converter
   substrait_common
   substrait_expression
-  substrait_io
   substrait_proto
   symbol_table
   error_listener

The other cycle is due to the two functions typeToText and relationToText in SymbolTablePrinter.cpp. Without those, symbol_table does not need to depend on substrait_textplan_converter anymore. The solution is probably to move these functions into that target.
I'm calling it a day now but I'll probably try that out and create a PR tomorrow if nobody beats me to it.

Resolved by #100.


contrib docs: update rfc and roadmap links

I wonder if this is a old vs new projects thing.  When I migrated to the new projects system, i wasn't given any choice of what it did (granted, migration itself is still in preview)

@bors r+

:hourglass: Testing commit 7d0cf18ee5405b94f3cb9fca9ff7a6a982a447b2 with merge e6b24be83f600e833fc3f11eb38eacc503f826f3...

I see. I've prefixed all of them with "Cargo". Thank you.

:sunny: Test successful - checks-actions
Approved by: epage
Pushing e6b24be83f600e833fc3f11eb38eacc503f826f3 to master...


vmexport: enable status subresource for VirtualMachineExport

What this PR does
Before this PR:
After this PR:
status subresource enabled and consumed by virt-controller

Fixes #
Why we need it and why it was done in this way
The following tradeoffs were made:
The following alternatives were considered:
Links to places where the discussion took place:
Special notes for your reviewer

Checklist
This checklist is not enforcing, but it's a reminder of items that could be relevant to every PR.
Approvers are expected to review this list.

[ ] Design: A design document was considered and is present (link) or not required
[ ] PR: The PR description is expressive enough and will help future contributors
[ ] Code: Write code that humans can understand and Keep it simple
[ ] Refactor: You have left the code cleaner than you found it (Boy Scout Rule)
[ ] Upgrade: Impact of this change on upgrade flows was considered and addressed if required
[ ] Testing: New code requires new unit tests. New features and bug fixes require at least on e2e test
[ ] Documentation: A user-guide update was considered and is present (link) or not required. You want a user-guide update if it's a user facing feature / API change.
[ ] Community: Announcement to kubevirt-dev was considered

Release note

vmexport: enable status subresource for VirtualMachineExport

/lgtm

/hold
For result of discussion in #12597

/lgtm

@mhenriks what about replacing the UpdateStatus with Patch?

@alicefr I think UpdateStatus() makes more sense at this point given the way things are currently structured. if @awels wants to switch to patch would be best to do in a different PR

/unhold


Obfuscation of class names

The output of fullOptJS is well minimised and obfuscated with the exception of all the class names.  The plain readability (and thus easier backward-engineerability) is a significant concern. Addressing this would bring the size down too, looking at a bit of code I'm working on, 40k of my 557k file (7.3%) appears to be just class names.
Are there any plans or ideas in the pipeline around this?

AWesome! Thanks again!

It appears that case classes and case objects still keep their name in the final JS file.

Case classes and case objects have a specified .toString() which includes their unqualified name, yes. That's part of Scala's specified semantics and enforced by the scalac compiler. There is nothing Scala.js can do about those (nor do I think we should do anything).


Emit of union type metadata in nullStrictMode is always Object

TypeScript Version:  2.1.1 / nightly (2.2.0-dev.201xxxxx)
function annotation(): PropertyDecorator {
    return (target: any, key: string | symbol): void => { };
}

class A {

    @annotation()
    field: B | null | undefined;
}

class B {
    field1: number;
}

Expected behavior:

function annotation() {
    return function (target, key) { };
}
var A = (function () {
    function A() {
    }
    __decorate([
        annotation(),
        __metadata('design:type', B)
    ], A.prototype, "field", void 0);
    return A;
}());
var B = (function () {
    function B() {
    }
    return B;
}());

Actual behavior:

function annotation() {
    return function (target, key) { };
}
var A = (function () {
    function A() {
    }
    __decorate([
        annotation(),
        __metadata('design:type', Object) //<-- should be B
    ], A.prototype, "field", void 0);
    return A;
}());
var B = (function () {
    function B() {
    }
    return B;
}());

#11391

Union types are emitted as Object since there is no way to express the union using runtime values.

I disagree. I don't argue that all union types should behave like I have mentioned, but only when single type unioned with null or undefined or both.
I see this union as special case, cause the only type you should to emit is the B type, null and undefined by them self are not types, but definition for missing states (so they don't need to be reflected in meta in any way)
if you still think it is working as intended. you should mark this future as Breaking change
Till the use of strictNull I could do the following:

class A {}

class B
{
   @dec()
   field: A
}

const variable: B;
variable.field = null;

and the code would compile as expected and field type would be emitted as expected allowing me at  Runtime to expect it and use it.
now, when the strict flag is on, all fields that can accept null or undefined, emitted as Object type, which become the metadata unusable in my case and I guess for others who relied on this behavior

if you are not using --strictNullChecks, both null and undefined are in the domain of all types. so you could assign null to any variable with no errors. with --strictNullChecks, this becomes more strict, and you need to mark ones that accept null or undefined

I understand that,
I want to enjoy the strict mode future and it great code analysis, but still without loosing all benefits of the less strict mode that I was using before.
the null | undefined addition  was seemed straight forward change, but now cause of the union definition, the metadata loosing it purpose, and it breaking my code that relies on this emit.
I looking a way to  enjoy both worlds :-)

why is Foo | null any different from Foo | number?

As I see it,
Foo | number union is splitted to two different valid types in javascript world. number is primitive type and Foo is descendant of Object type.
Foo | null union is a more special case. if we try to split it, we will find only Foo type and null hint for compiler, tells that field defined with that union can have valid Foo type or being null reference. from JavaScript perspective, null is not a Object descendant or primitive type.
this definition could be the same:
let defined: @Null() decorator that hints compiler, field can have null reference
let defined: @Undefined() decorator that hints compiler, field can have undefined state
then in theory this definition should be equal:

class A
{
     field: Foo | null | undefined;
}

class B
{
    @Null()
    @Undefined()
    field: Foo;
}

on both cases the compiler will understand the hint for allowing null | undefined definitions and code analysis would work, but in A type the union will emit Object type meta, in B the emit will be B type
for my opinion, the null, undefined tokens should be ignored  only on metadata emit, they should still continue to participate in all other aspects for the union compilation logic


Any plan to support postgres(sql) & relay & react-router?

GREAT GREAT WORK i've seen for now.
AAA are really useful for me, i'm wondering if it is possible(or plan) to support:

AAA based on postgres(sql)
relay (heard that relay could coexist with flux, also noticed your version of relay)
react-router 1.0 (is vstack-router better ?)

for future version of ripster?
many many thanks!
hope ripster  to become a real powerful framework for modern web develpment even native app develpment!

Hello!
Thank you for your feedback and sorry for long delay. I was on vacation all this time.
First of all I should tell that Ripster is totalitarian framework. It means that Ripster provides only one solution for every problem. I won't support all databases, all routers, all validators, etc. Also it means that Ripster includes only those solutions that I like.
I'll try to answer your questions:

I don't think I will support PostgreSQL because I don't use it. But you could change any part of Ripster in your fork. You can ask me any question about Rispter internals.
Yes, I will support Relay with Redux. Stay tuned.
Right now vstack-router is better for me, but I'll think about migration to RR1.0 after Relay support.

Thank you for reply. Really exciting about the future work. again thanks for the great work.


Add option to use DDMStructures and DDMTemplates for generated Web Contents

Existing Structures and Templates should be possible to use by Web Contents generated by the tool. Some issues come on surface related to content editing when specific structures are used.

Hi @vilmospapp
I can add pull downs to let users select structures and templates. Is it ok just generating empty contents with the selected structure and template or, do you want to insert some contents into fields where you desire?

Hi @yasuflatland-lf
I think some precreated dummy structures and templates could be good and they should be prefilled with dummy content.

Hi @vilmospapp , Ok, so you mean providing pulldowns for selecting structure and a template is good enough?

I think it should be enough.

@vilmospapp  Implemented in ef924427a62a4f2af450cdedb8a7a8208e93ce7c


Add v4Package Schema

We are adding updates to packages. As part of this effort we are adding a new package specification which encodes upgrade information. Specifically we are adding a field that shows for a given package A, what other packages upgrades=[B, C, D] are able to upgrade to A.

Also, I assume we're not creating a version-4.x branch of the repo this time, since we now have the schema versions?

@larioj overall looks good, had a few comments.


Support for logging any deep structure/table

I'd like to be able to log any deep structure or table (...and not only BAPIRET2, BDCMSGCOLL and HRPAD_MESSAGE).
My use case is to log the request and response structure of a SOAP web service call (which often consists of table types) if it fails.
I could imagine converting structures and tables to a JSON like string, pretty print it (with line breaks) and logging it line by line.
What do you think?

This issue could be closed now, could it not?

I noticed only one problem with the new support for any structure, and that is that fields in .INCLUDE structures are not logged unless the .INCLUDE has been named ('Group')

Thanks for testing. I will check on that. If you already know how to fix it, you can create a pull request.
Support for tables is still missing. That is the main reason this issue is still open.

For the moment I updated the structures i needed to log and named the includes, as they were in customer name space. I'll have a look at it and let you know (e.g. with pull request) if I find a solution.

The solution to log all INCLUDE structures is quite simple.
Use sy-tabix instead of component name, so in the add_structure method:.
loop at components into component.
assign component sy-tabix of structure obj_to_log to .
Looking into logging of tables.


ProtoRev: Proto code and Init scaffolding code

What is the purpose of the change
This PR is the first step in building and deploying the x/protorev module. Currently, we have implemented an end to end working V1 of the module, but are breaking down the implementation into modular PRs. The current V1 can be found here.
This PR includes all of the proto and basic app configuration code. Much of the boilerplate code for the module is also in this PR. Although this includes all of the proto code that will be used end to end, some of it will be implemented in subsequent PRs.
Brief Changelog

Init proto code for the module
Hook up x/protorev to the app
Genesis code + stateless validation
Keeper interfaces (dependencies with gamm, epoch, etc.)
Implementing the Msg types + stateless validation
Governance proposals handlers + stateless validation
TokenPairArbRoutes stateless validation (read more about this in the spec linked below)

Testing and Verifying
This change added tests and can be verified as follows:

Added unit tests for stateless validation for the genesis state
Added unit tests for stateless validation for Msgs
Added unit tests for stateless validation of governance proposals

Documentation and Release Note
The current WIP spec for x/protorev can be found here. Most answers surrounding design decisions can be found in the spec (feel free to ask if something is missing).
Genesis State
Genesis state can be configured with a preset number of hot routes. Additionally, it can be configured to be on or off by default (through params).
TokenPairArbRoutes
There are two methods of which the module will create cyclic arbitrage routes (i.e. trades). One will use the highest liquidity pools and the other will use a manually entered set of searcher routes (hot routes) that are typically used on chain but may not be included in the highest liquidity pool method. TokenPairArbRoutes is how all of the hot routes are stored in the module.
Governance Proposals
There are two proposals that will be implemented:

Enabling/Disabling x/protorev
Setting the Admin account

The first proposal will allow the chain to turn the module on/off if desired. The second proposal allows the chain to select an admin account that will be setting hot routes.
Queries
There are several queries that will be implemented in a later PR. Most of them allow users to request information about how profitable x/protorev has been.
Msgs
There are two valid messages that will be implemented:

SetHotRoutes
SetDeveloperAccount

Both of these Msgs can only be called by the admin account which must be initialized through governance.
Expected Keepers
The module primarily interacts with the x/gamm module. However, it also needs access to the bankkeeper in order to mint and burn coins for trades and send profits to the developer address (which will be Skip's address). Additionally, there are stateful changes that need to occur every so often so the epoch keeper is also expected.

Pushed changes to remove map usage from the PoolStatistics proto and refactored error handling. @ValarDragon would you happen you know why the e2e test suite is failing? Is it safe to merge without it passing?

This is not safe to merge yet, I believe its a bug. Here are the logs from the container running the test that it halted on
1:34AM INF indexed block exents height=125 module=txindex
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0xd519d4]

goroutine 3991 [running]:
github.com/cosmos/iavl.(*nodeDB).incrVersionReaders(0x2a8edc8?, 0x20?)
        github.com/cosmos/iavl@v0.19.4/nodedb.go:943 +0x24
github.com/cosmos/iavl.newExporter(0x400a52ce60)
        github.com/cosmos/iavl@v0.19.4/export.go:46 +0xd0
github.com/cosmos/iavl.(*ImmutableTree).Export(...)
        github.com/cosmos/iavl@v0.19.4/immutable_tree.go:159
github.com/cosmos/cosmos-sdk/store/iavl.(*Store).Export(0x400a527758?, 0x2a7a3e0?)
        github.com/cosmos/cosmos-sdk@v0.46.6/store/iavl/store.go:284 +0x54
github.com/cosmos/cosmos-sdk/store/rootmulti.(*Store).Snapshot(0x4001059080, 0x7d, {0x2a6f340, 0x400a25c930})
        github.com/cosmos/cosmos-sdk@v0.46.6/store/rootmulti/store.go:733 +0x538
github.com/cosmos/cosmos-sdk/snapshots.(*Manager).createSnapshot(0x40001d0a20, 0x48a3f4?, 0x40018a4740?)
        github.com/cosmos/cosmos-sdk@v0.46.6/snapshots/manager.go:216 +0x88
created by github.com/cosmos/cosmos-sdk/snapshots.(*Manager).Create
        github.com/cosmos/cosmos-sdk@v0.46.6/snapshots/manager.go:203 +0x1f8

It is failing where we lock and add to existing lock


Implement output to COTI packages

Hi,
could you please implement a real COmmon Translation Interface (COTI) conform package export/import? COTI is a "German standard" of the DERCOM association, see DERCOM - Projekte. COTI is actually a ZIP file with some XML metadata. You can download the spec in a ZIP file from the above mentioned URL.
Thanks a lot,
Stefan

We are not familiar with this standard, we'll leave the issue opened and if anybody else will be interested maybe they can provide us with some guidance about how this could be implemented.

@raducoravu, the spec and XSDs and so forth are in the ZIP archive.


Configuration When Used With Fastboot

Thank you for your work on bringing PWAs to Ember. I've followed the thread of setting up a PWA with Ember from https://dockyard.com/blog/2017/07/20/how-to-build-a-pwa-with-ember to this library including ember-web-app, ember-service-worker, ember-service-worker-asset-cache, ember-service-worker-cache-fallback, and ember-service-worker-index.
It was https://github.com/DockYard/ember-service-worker-index/issues/5 that brought me here looking for a solution to how to properly configure everything for a Fastboot environment.
Is there a recommended configuration?

I'm facing the same issue. Basically, ember-service-worker-index will always return the contents of index.html for text/html requests. This basically disables FastBoot, but also has the advantage it serves a cached version of the page when offline for any URL, previously cached or not.
OTOH If you configure ember-service-worker-cache-fallback to cache your pages (e.g. by adding /(.*) to the patterns), it will cache the rendered FastBoot output, but requests for any url not cached previously will fail.
Personally I think one optimal solution for this would be to combine the two behaviours: if a cached version of the specific rendered url exists, return it, else fallback to the index.html which will be empty but will make the app continue working while offline.


telescope naming (revisit)

Telescope names are used for naming datasets in the DL1/DL2 output files.
Right now, we name these using  "opticstype_opticssubtype_camera" naming, but for telescopes like "MST", there is no subtype, so we use "MST_MST_NectarCam", which is a bit ugly (it's nicer for something like "SST_ASTRI_CHEC"). Can we do better?
should be parsiable (e.g. easy to turn a name back into a telescope with correct optics type and camera type)
should we encode versions? (NectarCam_002)l or just leave that to metadata?
the problem is less once CTA has chosen which telescopes it will build, so we have to support fewer combinations.

Discussion: just combine optics and camera into a single "type", so we just use "telescope-class_telescopename" (e.g. MST_NectarCam, or SST_ASTRICHEC)

should consider future where SSTs/LSTs/MSTs are relatively fixed.
is there a real name for LSTCam?
should be future proof: if we change MST structure, or swap cameras....

I think the LST cam was refered to as DragonCam in the past

The simtel metadata has OPTICS_NAME and CAMERA_NAME, which I think is good.
I would go for having the telescope type be{OPTICS_NAME}_{CAMERA_NAME}, e.g. LST_LSTCam/MST_NectarCam/ASTRI_CHEC`, type should be one of LST / MST / SST, but this could be purely determined based on mirror area / diameter.
Then, TelescopeDescription should also have a name, which could be LST-1, MST-02 for each telescope, but is not participating in the hash (or we need to seperate TelescopeType from Telescope.


Visual Studio Online build integration.

Adds support for Visual Studio Oline build badges.  This uses the fetchFromSvg function to read a string from the badge SVG data.
Test cases:
/vso/build/schwabencode/1838fe47-1e26-4f59-924a-59ea28e64d6a/9.svg
/vso/build/larsbrinkhoff/953a34b9-5966-4923-a48a-c41874cfb5f5/1.svg
Fixes #522.

That was fast. Nice!

Badge text "never built" is missing.
See https://gist.githubusercontent.com/BenjaminAbt/16d07510221d8d2dc8b4/raw/0a38d505ed372bbf83eb98ab9fe4e550717fe8a5/vsts-build-badge-never-built.svg

As far as I can see, any unrecognized status text should end up in the badge.  Do you have a test case?  I.e. a username/projectid/buildid triplet which returns "never built".

Creates this test case for you.
Will delete this, when it's done and merged
https://schwabencode.visualstudio.com/DefaultCollection/_apis/public/build/definitions/1838fe47-1e26-4f59-924a-59ea28e64d6a/12/badge

I get this:  (This is also a transient link.  May dissapear any moment.)
Seems ok.

For further tests you can also see it here in my badge overview:
https://github.com/SchwabenCode/QuickIO/tree/develop

This seems swell!
I am wondering: would it be intuitive for anyone what to fill into the URL to get their own badge, seeing only this: https://img.shields.io/vso/build/larsbrinkhoff/953a34b9-5966-4923-a48a-c41874cfb5f5/1.svg?

would it be intuitive for anyone what to fill into the URL to get their own badge, seeing only this: https://img.shields.io/vso/build/larsbrinkhoff/953a34b9-5966-4923-a48a-c41874cfb5f5/1.svg?

Not quite.  How do I document where to get the inputs?

And you have to check the "badge link" option in your build definition in VSO.
Otherwise it would not work.

I think you maybe have to document this.. :-(

How do I document where to get the inputs?

Ideally, though the popup that appears when you click on the badge, but we would need to generalize that type of documentation. I'll try to create that system.

I put it live. Tell me how well it does by going to https://img.shields.io/try.html. There, you can click on the VSO badge to get the documentation. If the documentation you see there is incomplete or inaccurate, please modify it here: https://github.com/badges/shields/blob/0536763b498b865e65db31243512356e7bcd2295/try.html#L1030.

Great, works fine. Tested that stuff with 2 build definitions.

Looks fine to me.


libtiff: add patches for CVE-2022-3626, CVE-2022-3627, CVE-2022-3597, CVE-2022-3598 & CVE-2022-3570

Description of changes
https://nvd.nist.gov/vuln/detail/CVE-2022-3626
https://nvd.nist.gov/vuln/detail/CVE-2022-3627
https://nvd.nist.gov/vuln/detail/CVE-2022-3597
https://nvd.nist.gov/vuln/detail/CVE-2022-3598
https://nvd.nist.gov/vuln/detail/CVE-2022-3570
Personally tested this fixes all the supplied PoCs.
Not included: fix for https://nvd.nist.gov/vuln/detail/CVE-2022-3599 - its fix is more involved and has barely been merged a week. Not something I want to make a rush for.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[x] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

@risicle considering that the auto-backport failed, was this ever backported?


Apostille "keep private" isn't working

when I try to check the keep private box, it stamps the file fine and I get the download, but then when I try to audit it, I get the message, "Verification failed, an error occured at signature verification !"

I did it twice with two different files and it worked. Could you try it again?

Bug confirmed in 1.0.10, some private keys starts with "00" and they need a special fix that I forgot to apply. So in such cases the signature is invalid.
Fixed in upcoming 1.0.13

confirmed fixed


BadZipFile during the installation

I have a BadZipFileError when I tried to install etl.
In a shell I use the command:

git clone https://github.com/owid/etl.git
cd etl
make test
make test
(I really do 2 make test)
make etl

I put 3 screenshot in hope that will help you resolve my problem.
Thank you in advance.

The failing step data://meadow/hyde/2017/baseline depends on raw data walden://hyde/2017/baseline that is stored here. The file has 5GB so it's possible the downloading has been interrupted and the file cannot be opened (hence BadZipFile). The file should have been downloaded to ~/.owid/walden/hyde/2017/baseline.zip. Could you check whether the file has indeed 5GB?
If yes, can you run md5sum ~/.owid/walden/hyde/2017/baseline.zip and check if it equals acdbbd3908a29fb8ae75f3e081c980ad?
In case the file isn't complete, you should remove it and run ./venv/bin/etl data://meadow/hyde/2017/baseline which will run only the step and its dependencies.

The file baseline.zip had 397.5MB instead of 5GB.
So I delete it and do .venv/bin/etl data://meadow/hyde/2017/baseline
But now another error has appeared. I have a CancelledError and a DeadKernelError.

If I do md5sum ~/.owid/walden/hyde/2017/baseline.zip, this is what I see.

The make test continue to have 12 passed and 3 warnings.
Now if I do make etl, I have a CancelledError and a DeadKernelError.

My machine is a 4gb memory machine. So I change the dag.yml file.
In this file, it rest:
steps:

  # Examples
  data://examples/script/script_example:
    - walden://wb/2021-07-01/wb_income
    - data://garden/owid/latest/key_indicators
    - data://garden/reference
  data://examples/jupytext/jupytext_example:
  data://examples/vs_code_cells/vs_code_cells_example:
  # private steps that require S3 access keys for private walden
  data-private://examples/private/2022-03-08/private_example:
    # NOTE: this dataset is public as we don't have any private data yet
    - walden-private://faostat/2022-02-10/faostat_metadata
    - data://garden/reference

So now I have no problem with make etl. I'm just processing less data.

So now I have no problem with make etl. I'm just processing less data.

Great, I'm glad you were able to figure it out! We plan to create exactly what you did - smaller DAG file that could be run without needing excessive memory or cpu.

If you do not want to modify the DAG file, this is what you coud do:
    - git clone https://github.com/owid/etl.git
    - cd etl
    - make test
    - make test
    - poetry run etl examples

Because this issue was to resolve BadZipFileError and there is no more BadZipFileError, I will close this issue.


django-shop

OperationalError at /shop/products/
no such table: shop_product
Request Method: 	GET
Request URL: 	http://<IP_ADDRESS>:8000/shop/products/
Django Version: 	1.8.5
Exception Type: 	OperationalError
Exception Value:
no such table: shop_product
Exception Location: 	/home/pradeep/.local/lib/python2.7/site-packages/django/db/backends/sqlite3/base.py in execute, line 318
Python Executable: 	/usr/bin/python2.7
Python Version: 	2.7.6
Python Path:
['/home/pradeep/Desktop/srit',
'/usr/local/lib/python2.7/dist-packages/setuptools-5.7-py2.7.egg',
'/usr/local/lib/python2.7/dist-packages/pip-1.5.6-py2.7.egg',
'/home/pradeep/Desktop/srit',
'/usr/lib/python2.7',
'/usr/lib/python2.7/plat-i386-linux-gnu',
'/usr/lib/python2.7/lib-tk',
'/usr/lib/python2.7/lib-old',
'/usr/lib/python2.7/lib-dynload',
'/home/pradeep/.local/lib/python2.7/site-packages',
'/usr/local/lib/python2.7/dist-packages',
'/usr/lib/python2.7/dist-packages',
'/usr/lib/python2.7/dist-packages/PILcompat',
'/usr/lib/python2.7/dist-packages/gtk-2.0',
'/usr/lib/python2.7/dist-packages/ubuntu-sso-client']
Server time: 	Wed, 25 Nov 2015 08:33:43 +0000
Error during template rendering
In template /home/pradeep/.local/lib/python2.7/site-packages/shop/templates/shop/product_list.html, error at line 7

Hi, I'd suggest to try to tackle this a bit on your own. Did you even do migration? If it is a problem which you cannot overcome then please include what you tried. This is not a commercial support. This is developer's forum where people spend their free time. So please take this into account and try to be more humble and helpful.

thanks atheiste that works


Evaluate dotgpg alternatives for adoptopenjdk/secrets

This is a repository that got skipped during the migration. It goes in tandem with this infrastructure repository but requires separate access controls as not all temurin or infrastructure members have access to it.

I'm 50:50 (ok 33:33:33) between

Continuing with dotgpg (GH repo)
Moving to https://www.passwordstore.org/ (Used by Eclipse)
Shift everything in BitWarden (which supports sharing of text files to cover "documentation" we have in there).

Types of data which we need to decide on a home for:

[ ] Infra providers (Covered by BitWarden)
[ ] System passwords
[ ] SSH / GPG / RSA credentials
[ ] Notes with contact details etc.

Note that passwordstore, while it can handle multiline data as an option, is mostly designed for the "System password" use case.


Fix: Raise NotImplemented, remove init

Description

I was not raising an error which was bad practice.
Also, removed the __init__.py in main level as it was causing issues with the editable installation of the app

Pull Request Test Coverage Report for Build 8e95187e4a26182f530c03eef9e61dfbd330d50a-PR-176

1 of 2 (50.0%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.03%) to 63.21%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

core/main.py
0
1
0.0%

Totals

Change from base Build c155e24c1662af1180127eae55ab58f977a0adc2:
0.03%

Covered Lines:
512

Relevant Lines:
810

💛  - Coveralls


integrations: Distinguish between static/ URLs and logo file paths.

Previously, to check whether a logo file existed, we simply took
the static/ URL for the logo and treated it as a file path. This
led to problems when static/* was not the correct parent directory
for our static files (for example, when settings.PRODUCTION = True).
Now, we treat URLs and file paths differently and the logo file
path is constructed by joining settings.STATIC_ROOT and the
relative path to the logo file.
Fixes #7018.
@timabbott: FYI

Merged, thanks @eeshangarg!


FR: Adaptive icon

Api 26 introduced adaptive icons where background and foreground are two different images.
https://developer.android.com/guide/practices/ui_guidelines/icon_design_adaptive.html

I plan to work on it (mostly because I need to contribute to open-source projects to pass my subject at university). Are there any specific suggestions how it should look like or be done?

I'm interested too.

you should fix it to upload new version to google play
https://www.xda-developers.com/google-play-app-updates-must-target-android-8-0/
so it's a BUG and not a RF more

Fixed in master.

What about to release it?