High memory usage when uploading to Azure Storage

Describe the bug
I see very high memory usage when uploading large files to Azure Storage.  For example, a 221MB file upload results in using over 221MB of memory.  I see this behavior when uploading to actual Azure Storage as well as uploading to Azurite locally.
It seems like something in the tusd Azure Storage code may be retaining all of the file info in memory, instead of streaming it to Azure Storage or an Azure Storage emulator, like Azurite.
To Reproduce
Steps to reproduce the behavior:

Setup tusd to upload to Azure Storage
Ensure you have a way to monitor memory on the tusd server
Upload a large file >= 221MB
Look at the memory usage after

Expected behavior
I would expect the memory usage to stay relatively low.
Setup details
Please provide following details, if applicable to your situation:

Operating System: Running tusd docker image tusproject/tusd:v2.0
Used tusd version: 2.0
Used tusd data storage: Azure Storage
Used tusd configuration:

--azure-storage uploads --azure-endpoint https://AZURE-ACCOUNT.blob.core.windows.net --hooks-http MYWEBHOOKURL --hooks-http-forward-headers Authorization --hooks-enabled-events pre-create,pre-finish --cors-expose-headers X-Upload-Properties-Set,X-Upload-File-Path --behind-proxy --expose-pprof

I use --behind-proxy on Azure only, not locally. But I see the problem both locally and on Azure.

Used tus client library: Uppy.js

here's a heap dump of me running it locally:
heap.txt

From https://community.transloadit.com/t/tusd-failing-on-large-file-upload/16883/11

From the heap dump, it is apparent that there is a 128MB and a 64MB allocated at
#	0x1007dd07b	bytes.growSlice+0x8b									/usr/local/go/src/bytes/buffer.go:249
#	0x1007dca9b	bytes.(*Buffer).grow+0x12b								/usr/local/go/src/bytes/buffer.go:151
#	0x1007dcea3	bytes.(*Buffer).ReadFrom+0x43								/usr/local/go/src/bytes/buffer.go:209
#	0x100912e57	bufio.(*Reader).WriteTo+0xb7								/usr/local/go/src/bufio/bufio.go:533
#	0x100aa2dbf	github.com/tus/tusd/v2/pkg/azurestore.(*AzUpload).WriteChunk+0x13f			/Users/jspath/git/tusd/pkg/azurestore/azurestore.go:145

It does indeed seems like that azurestore is copying the entire upload data into a memory buffer before uploading it to Azure: https://github.com/tus/tusd/blob/79709611ce7c32e784f2c609e993b5484a09f5a0/pkg/azurestore/azurestore.go#L143-L148
A new buffer is created and the entire request body is written into the buffer before the final size is examined and the data is uploaded. No data is streamed. I am not sure if that is possible with Azure. @omBratteng, do you know if there is a better way to avoid these allocations? For the s3store we save chunks of data on disk to avoid in-memory buffers, for example.
@jspath-ankored Does the memory get properly released once the upload is completed? Or is the memory kept alive after the upload, meaning we would have a memory leak.

It's been a while since I worked with this and I have since gotten a new job.
But if I recall correctly, it only keeps the chunks in memory before it uploads it to blob storage. We have uploaded files of ~10TiB without any issues (though we didn't really have any memory constraints in our cluster).
Though, there shouldn't be any issues with save chunks of data on disk.

It looks like it's not a memory leak, and the memory does eventually get released:

It would still be preferable if the memory usage didn't grow like this ... I uploaded a 221MB file, and after the 2nd upload, we were using 922.8MB of memory.  This makes me concerned about using this on production.
I know you can stream to Azure Blob Storage in .NET ... not sure about Go.

the memory does eventually get released, although it takes around five minutes

I am no expert at Go's garbage collector, but Go might not release memory back to the OS immediately. The memory might be flagged internally as unused, but releasing it to the OS is another step that might only be taken when the memory is actually needed my another process. But please don't cite me on this :)

If it matters, I am measuring the memory using the Live Charts extension for Docker Desktop. So maybe I'm just measuring the memory that the Docker container is using.

If you want more insights into the memory usage as seen from the Go internals, you can use the metrics exposed by tusd (e.g. http://tusd.tusdemo.net/metrics). They contain many different memory-related metrics and might help you understand how much memory Go thinks is in use right now.
However, I agree that it would be ideal to avoid this in-memory buffering altogether. Would you be interested in trying out to stream the data directly to Azure (or stream it in chunks)?

Would you be interested in trying out to stream the data directly to Azure (or stream it in chunks)?

Yes.  We are not using tusd in production yet, and won't be a for a while yet, so I am open to trying out streaming.
Are you asking me to implement, or just try out some changes?

Are you asking me to implement

Yes, improving the memory usage of the Azure store would require some implementation changes. I personally do not use Azure on my own and don't have access to it, making me not the best person to tackle this.

We noticed that the body is ready into memory when reviewing the code before settling and tusd and decided to use 5 MiB Patch Chunks  in the clients for now. I'd like to have tried taking a stab at improving it but didn't have time for it :(

Does this also occur if you use Azurite? If so, I can try to reproduce it locally and debug it.

Does this also occur if you use Azurite? If so, I can try to reproduce it locally and debug it.

Yes, the same issue happens using Azurite locally:
https://community.transloadit.com/t/tusd-failing-on-large-file-upload/16883/4

I implemented the buffer in a temporary file on disk instead of in-memory. Please have a look at https://github.com/tus/tusd/pull/1070, test it out, and let me know if it behaves as expected, especially in terms of memory usage. In my local tests, no memory growth was visible over time.


Maintenance mode improvements

This adds a new script to unset maintenance mode, and also improves the docs, to be clearer about the two different scenarios where you might want to turn maintenance mode on / off.

 Maintenance mode


Delete Alma location marquand$ph

https://bibdata.princeton.edu/locations/holding_locations/marquand$ph
See: https://github.com/PrincetonUniversityLibrary/alma-config/issues/1150

There are still some items in marquand$ph https://github.com/pulibrary/bibdata/issues/2500
@pmgreen can you confirm when no items will be in this location so that we can delete it from bibdata?


Declare display error when view contains comments

System information:
Operating system (distribution) and version : Windows 11 pro 21H2  22000.348
DBeaver version <IP_ADDRESS>111141807
Additional extensions  NO
Connection specification: routine service Name
Database name and version Oracle 11G
Driver name  oracle.jdbc.OracleDriver
Do you use tunnels or proxies (SSH, SOCKS, etc)?  NO
Describe the problem you're observing:
When comments appear in the sub query in the view, the display will make an error when viewing the view
As shown in the figure, the red box indicates the desired Navicat effect on the right

Steps to reproduce, if exist:
Include any warning/errors/backtraces from the logs

@ReconditenessPerson  I was not able to reproduce it, can you please provide a basic DDL of a view for which this issue appears

@ReconditenessPerson I was not able to reproduce it, can you please provide a basic DDL of a view for which this issue appears

CREATE OR REPLACE FORCE VIEW "oracle"."V_PM_IN_CONTRACTRECEIVABLE" ("FID", "VERSION", "FYEAR", "FMONTH", "FREPORTPERIOD", "FBILLDATE", "FPROJECTID", "FPROJECTNAME", "FPROJECTCODE", "FREFORGFID", "FCONTRACTCODE", "FCONTRACTID", "FCONTRACTNAME", "FCONTRACTRECNO", "FPAYMENTTYPE", "FGUARANTEERATIO", "FLASTRECEIVEDATE", "FCONTRACTAGREERATIO", "FBUILDPROGRESS", "FREMARK", "FATTACHMENT", "FSETTLEMENTID", "FBIZSTATE", "FBIZSTATENAME", "FCREATETIME", "FCREATEPSNFID", "FCREATEPSNFNAME", "FTS", "FRECORDNO", "FRECORDDATE", "FVALUEADDEDTAXRATE", "FREPORTMODE", "FTITLE", "FLATESTCOLLECTIONTIME", "FCONTRACTAGREEPERIOD", "FREPORTNUMBER", "FPERIODID", "FPAYMENTMETHOD", "FISPAYMENTNODE", "FCONTRACTAGREEDAMOUNT", "FREPORTINGTYPE", "FAPPLYDATE", "FAPPROVEDATE", "FTEMPLATENAME", "FSTATE", "FATTACHMENTCN", "FCREATEDEPTID", "FSPLITCONTRACTID", "FTABLETYPE", "FCURRENTREPORTINGAMOUNT", "FADDUPREPORTINGAMOUNT", "FCURRENTAPPROVALNOTAXAMOUNT", "FCURRENTAPPROVALTAXVALUEAMOUNT", "FCURRENTAPPROVALTAXAMOUNT", "FADDUPAPPROVALNOTAXAMOUNT", "FADDUPAPPROVALTAXVALUEAMOUNT", "FADDUPAPPROVALTAXAMOUNT", "FCLOSINGUPPERIODTOTALTAX", "FCURRENTPERIODTAX", "FDEADLINETOTALTAX", "FDEADLINETOTALTAXYS") AS
SELECT
PM_IN_ContractReceivable.FID,
PM_IN_ContractReceivable.VERSION,
PM_IN_ContractReceivable.FYEAR,
PM_IN_ContractReceivable.FMONTH,
PM_IN_ContractReceivable.FREPORTPERIOD,
PM_IN_ContractReceivable.FBILLDATE,
PM_IN_ContractReceivable.FPROJECTID,
PM_IN_ContractReceivable.FPROJECTNAME,
PM_IN_ContractReceivable.FPROJECTCODE,
PR.fRefOrgFID,
PM_IN_ContractReceivable.FCONTRACTCODE,
PM_IN_ContractReceivable.FCONTRACTID,
PM_IN_ContractReceivable.FCONTRACTNAME,
PM_IN_ContractReceivable.FCONTRACTRECNO,
PM_IN_ContractReceivable.FPAYMENTTYPE,
PM_IN_ContractReceivable.FGUARANTEERATIO,
PM_IN_ContractReceivable.FLASTRECEIVEDATE,
PM_IN_ContractReceivable.FCONTRACTAGREERATIO,
PM_IN_ContractReceivable.fBuildProgress,
PM_IN_ContractReceivable.FREMARK,
PM_IN_ContractReceivable.FATTACHMENT,
PM_IN_ContractReceivable.FSETTLEMENTID,
PM_IN_ContractReceivable.FBIZSTATE,
PM_IN_ContractReceivable.FBIZSTATENAME,
PM_IN_ContractReceivable.FCREATETIME,
PM_IN_ContractReceivable.FCREATEPSNFID,
PM_IN_ContractReceivable.FCREATEPSNFNAME,
PM_IN_ContractReceivable.FTS,
PM_IN_ContractReceivable.fRecordNo,
PM_IN_ContractReceivable.fRecordDate,
PM_IN_ContractReceivable.fValueaddedTaxRate,
PM_IN_ContractReceivable.fReportMode,
PM_IN_ContractReceivable.fTitle,
PM_IN_ContractReceivable.fLatestCollectionTime,
PM_IN_ContractReceivable.fContractAgreePeriod,
PM_IN_ContractReceivable.fReportNumber,
PM_IN_ContractReceivable.fPeriodID,
PM_IN_ContractReceivable.fPaymentMethod,
PM_IN_ContractReceivable.fISPaymentNode,
PM_IN_ContractReceivable.fContractAgreedAmount,
PM_IN_ContractReceivable.fReportingType,
PM_IN_ContractReceivable.fApplyDate,
PM_IN_ContractReceivable.fApproveDate,
PM_IN_ContractReceivable.fTemplateName,
PM_IN_ContractReceivable.fState,
PM_IN_ContractReceivable.fAttachmentCN,
PM_IN_ContractReceivable.FCREATEDEPTID,
PM_IN_ContractReceivable.fSplitContractID,
PM_IN_ContractReceivable.fTableType,
--当期申报额
PM_IN_ContractReceivable.fCurrentReportingAmount,
--累计申报额（含税）
PM_IN_ContractReceivable.fAddUpReportingAmount,
--当期-审批总金额（不含税）
PM_IN_ContractReceivable.fCurrentApprovalNoTaxAmount,
--当期-增值税额
PM_IN_ContractReceivable.fCurrentApprovalTaxValueAmount,
--当期-审批总金额（含税）
PM_IN_ContractReceivable.fCurrentApprovalTaxAmount,
--累计-审批总金额（不含税）
PM_IN_ContractReceivable.fAddUpApprovalNoTaxAmount,
--累计-增值税额
PM_IN_ContractReceivable.fAddUpApprovalTaxValueAmount,
--累计-审批总金额（含税）
PM_IN_ContractReceivable.fAddUpApprovalTaxAmount,
--应收-截止上期含税总金额
PM_IN_CONTRACTRECEIVABLEDETAIL.FCLOSINGUPPERIODTOTALTAX,
--应收-本期含税总金额
PM_IN_CONTRACTRECEIVABLEDETAIL.FCURRENTPERIODTAX,
--应收-截止本期含税总金额
PM_IN_CONTRACTRECEIVABLEDETAIL.FDEADLINETOTALTAX,
--合同约定收款比例
PM_IN_CONTRACTRECEIVABLEDETAIL.FDEADLINETOTALTAXYS
FROM
(
SELECT
fid,
--版本
version,
--年份
fYear,
--月份
case when length(fMonth) = 1 then '0' || fMonth else fMonth end as fMonth,
--报量期间
fReportPeriod,
--单据日期
fBillDate,
--项目ID
fProjectID,
--项目名称
fProjectName,
--项目编码
fProjectCode,
--合同编号
fContractCode,
--合同ID
fContractID,
--合同名称
fContractName,
--合同应收款单编号
fContractRecNo,
--收款方式
fPaymentType,
--保修金比例
fGuaranteeRatio,
--合同最晚收款时间
fLastReceiveDate,
--合同约定收款比例
fContractAgreeRatio,
--施工进度
fBuildProgress,
--备注
fRemark,
--附件
fAttachment,
--结算ID
fSettlementID,
--流程状态名称
fBizState,
fBizStateName,
--创建时间
fCreateTime,
--提交人员FullID
fCreatePsnFID,
--提交人员FullName
fCreatePsnFName,
--修改时间戳（最后修改时间）
fTS,
--单据编号
'' as fRecordNo,
--单据日期
null as fRecordDate,
--增值税率
null as fValueaddedTaxRate,
--报量方式
'' as fReportMode,
--单据名称
'' as fTitle,
--合同最晚收款时间
null as fLatestCollectionTime,
--合同约定收款期限（日历天）
null as fContractAgreePeriod,
--报量编号
'' as fReportNumber,
--月度报量ID
'' as fPeriodID,
--付款方式
'' as fPaymentMethod,
--是否付款节点
'' as fISPaymentNode,
--合同约定当期应收款金额
null as fContractAgreedAmount,
--报量类型
'' as fReportingType,
--申报日期
null as fApplyDate,
--审批日期
null as fApproveDate,
--模板名称
'' as fTemplateName,
--状态
fBizStateName as fState,
--合同收款单附件
null as fAttachmentCN,
--提交部门ID
'' as FCREATEDEPTID,
--拆分合同ID
'' as fSplitContractID,
--当期申报额
0 as fCurrentReportingAmount,
--累计申报额（含税）
(select sum(MM.fCurrentReportingAmount) from (select M.fProjectID,D.fCurrentReportingAmount from PM_IN_QuantitiesConfirm M left join PM_IN_QuantitiesConfirmDetail D on M.fID = D.fMasterID  where D.FSUBITEMNAME = '合计') MM where MM.fProjectID = PM_IN_ContractReceivable.fProjectID) as fAddUpReportingAmount,
--当期-审批总金额（不含税）
0 as fCurrentApprovalNoTaxAmount,
--当期-增值税额
0 as fCurrentApprovalTaxValueAmount,
--当期-审批总金额（含税）
0 as fCurrentApprovalTaxAmount,
--累计-审批总金额（不含税）
(select sum(MM.fCurrentApprovalNoTaxAmount) from (select M.fProjectID,D.fCurrentApprovalNoTaxAmount from PM_IN_QuantitiesConfirm M left join PM_IN_QuantitiesConfirmDetail D on M.fID = D.fMasterID  where D.FSUBITEMNAME = '合计') MM where MM.fProjectID = PM_IN_ContractReceivable.fProjectID) as fAddUpApprovalNoTaxAmount,
--累计-增值税额
(select sum(MM.fCurrentApprovalTaxValueAmount) from (select M.fProjectID,D.fCurrentApprovalTaxValueAmount from PM_IN_QuantitiesConfirm M left join PM_IN_QuantitiesConfirmDetail D on M.fID = D.fMasterID  where D.FSUBITEMNAME = '合计') MM where MM.fProjectID = PM_IN_ContractReceivable.fProjectID) as fAddUpApprovalTaxValueAmount,
--累计-审批总金额（含税）
(select sum(MM.fCurrentApprovalTaxAmount) from (select M.fProjectID,D.fCurrentApprovalTaxAmount from PM_IN_QuantitiesConfirm M left join PM_IN_QuantitiesConfirmDetail D on M.fID = D.fMasterID  where D.FSUBITEMNAME = '合计') MM where MM.fProjectID = PM_IN_ContractReceivable.fProjectID) as fAddUpApprovalTaxAmount,
--表类型
fTableType
FROM
PM_IN_ContractReceivable UNION ALL
SELECT
fid,
--版本
version,
--年份
fYear,
--月份
fMonth,
--报量期间
fReportPeriod,
--单据日期
fRecordDate AS fBillDate,
--项目ID
fProjectID,
--项目名称
fProjectName,
--项目编码
fProjectCode,
--合同编号
fContractCode,
--合同ID
fContractID,
--合同名称
fContractName,
--合同应收款单编号
fContractRecNo,
--收款方式
fPaymentType,
--保修金比例
fGuaranteeRatio,
--合同最晚收款时间
fLastReceiveDate,
--合同约定收款比例
fContractAgreeRatio,
--施工进度
'' as fBuildProgress,
--备注
fRemark,
--附件
fAttachment,
--结算ID
fSettlementID,
--流程状态名称
'' AS fBizState,
fState AS fBizStateName,
--创建时间
fCreateTime,
--提交人员FullID
fCreatePsnFID,
--提交人员FullName
fCreatePsnFName,
--修改时间戳（最后修改时间）
fTS,
--单据编号
fRecordNo,
--单据日期
fRecordDate,
--增值税率
fValueaddedTaxRate,
--报量方式
fReportMode,
--单据名称
fTitle,
--合同最晚收款时间
fLatestCollectionTime,
--合同约定收款期限（日历天）
fContractAgreePeriod,
--报量编号
fReportNumber,
--月度报量ID
fPeriodID,
--付款方式
fPaymentMethod,
--是否付款节点
fISPaymentNode,
--合同约定当期应收款金额
fContractAgreedAmount,
--报量类型
fReportingType,
--申报日期
fApplyDate,
--审批日期
fApproveDate,
--模板名称
fTemplateName,
--状态
fState,
--合同收款单附件
fAttachmentCN,
--提交部门ID
FCREATEDEPTID,
--拆分合同ID
fSplitContractID,
--当期申报额
(select fCurrentReportingAmount from PM_IN_QuantitiesConfirmDetail where fMasterID = PM_IN_QuantitiesConfirm.fid and FSUBITEMNAME = '合计' ) as fCurrentReportingAmount,
--累计申报额（含税）
(select fAddUpReportingAmount from PM_IN_QuantitiesConfirmDetail where fMasterID = PM_IN_QuantitiesConfirm.fid and FSUBITEMNAME = '合计' ) as fAddUpReportingAmount,
--当期-审批总金额（不含税）
(select fCurrentApprovalNoTaxAmount from PM_IN_QuantitiesConfirmDetail where fMasterID = PM_IN_QuantitiesConfirm.fid and FSUBITEMNAME = '合计' ) as fCurrentApprovalNoTaxAmount,
--当期-增值税额
(select fCurrentApprovalTaxValueAmount from PM_IN_QuantitiesConfirmDetail where fMasterID = PM_IN_QuantitiesConfirm.fid and FSUBITEMNAME = '合计' ) as fCurrentApprovalTaxValueAmount,
--当期-审批总金额（含税）
(select fCurrentApprovalTaxAmount from PM_IN_QuantitiesConfirmDetail where fMasterID = PM_IN_QuantitiesConfirm.fid and FSUBITEMNAME = '合计' ) as fCurrentApprovalTaxAmount,
--累计-审批总金额（不含税）
(select fAddUpApprovalNoTaxAmount from PM_IN_QuantitiesConfirmDetail where fMasterID = PM_IN_QuantitiesConfirm.fid and FSUBITEMNAME = '合计' ) as fAddUpApprovalNoTaxAmount,
--累计-增值税额
(select fAddUpApprovalTaxValueAmount from PM_IN_QuantitiesConfirmDetail where fMasterID = PM_IN_QuantitiesConfirm.fid and FSUBITEMNAME = '合计' ) as fAddUpApprovalTaxValueAmount,
--累计-审批总金额（含税）
(select fAddUpApprovalTaxAmount from PM_IN_QuantitiesConfirmDetail where fMasterID = PM_IN_QuantitiesConfirm.fid and FSUBITEMNAME = '合计' ) as fAddUpApprovalTaxAmount,
--表类型
fTableType
FROM
PM_IN_QuantitiesConfirm
) PM_IN_ContractReceivable
LEFT JOIN (SELECT
FMAINID FMAINID,
FORDERNO FORDERNO,
FCLOSINGUPPERIODTOTALTAX FCLOSINGUPPERIODTOTALTAX,
FCURRENTPERIODTAX FCURRENTPERIODTAX,
FDEADLINETOTALTAX FDEADLINETOTALTAX
FROM PM_IN_CONTRACTRECEIVABLEDETAIL WHERE FORDERNO = '9' )
PM_IN_CONTRACTRECEIVABLEDETAIL ON PM_IN_ContractReceivable.FID = PM_IN_CONTRACTRECEIVABLEDETAIL.FMAINID
LEFT JOIN ( SELECT
FMAINID FMAINID,
FORDERNO FORDERNO,
FDEADLINETOTALTAX FDEADLINETOTALTAXYS
FROM PM_IN_CONTRACTRECEIVABLEDETAIL WHERE FORDERNO = '3' )
PM_IN_CONTRACTRECEIVABLEDETAIL ON PM_IN_ContractReceivable.FID = PM_IN_CONTRACTRECEIVABLEDETAIL.FMAINID
LEFT JOIN MA_PR_AccountObject PR ON PM_IN_ContractReceivable.FPROJECTID = PR.FID

@ReconditenessPerson Where do you see this bug? I tried to reproduce it and the comments are formatted correctly in view declaration

@ReconditenessPerson Where do you see this bug? I tried to reproduce it and the comments are formatted correctly in view declaration

Find the view object and open the declaration  , There are many other views as well .
I've reinstalled the software. It's still the same.
Every time an error occurs, it is annotated.
Operating the system character set   is  GBK
Dbeaver language is simplified Chinese
It is normal to open the same view on my other computer (the operating system is the same as the dbeaver version)

Can you please attach a file with script? Github may have erased some of the newline or other symbols.

你能附上一个带有脚本的文件吗？Github 可能已经删除了一些换行符或其他符号。
sql.txt

I updated the latest version of 21.3 Version 2, the problem still occurs

Can you please attach a file with script? Github may have erased some of the newline or other symbols.

I don't think it's a script problem, because the same script is displayed normally on the dbeaver on my other computer, and the operating system is consistent with the dbeaver version.

@ReconditenessPerson is it still actual for you?
unfortunately, still can not reproduce it. If it is still actual against the recent version, could you try to reset workspace and UI settings?


Variabilize PKI durations in values.yml

Related issue: https://github.com/scaleway/cert-manager-webhook-scaleway/issues/4

Thanks for your contribution 😄

Wow, I was writing a message on your Slack to notify the team, not even done and the PR is merged, impressive!
Thanks a lot! :smile:


no "Add Workspace Folder" action

My VSCode version is 1.79.2. It seems there is no "Add Workspace Folder" action button at welcome page. So is there any workaround to debug multiple nodes?

Hi,
I just checked, and the option is still there, it's just not mentioned anymore on the landing page.
You can access it through the vs code editor commands.
Just use the shortcut: CTRL+SHIFT+P and type
>Workspaces: Add Folder to Workspace

and then select the folder containing the node you want to debug

Hi @lzptr
Thanks for your reply!  Just as you said, i found it!


Error in Azure Training

System Information (please complete the following information):

Model Builder Version: (unknown, where is this?) Updated extension yesterday.
Visual Studio Version: Microsoft Visual Studio Enterprise 2019 Preview Version 16.6.0 Preview 2.1

Describe the bug
Object reference not set to an instance of an object.

at AzureML.AutoMLRunnerImages.<RunAutoMLAsync>d__27.MoveNext() in /_/src/Microsoft.ML.ModelBuilder.AutoMLService/RemoteAutoML/AutoMLRunnerImages.cs:line 231
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Microsoft.ML.ModelBuilder.AutoMLService.Experiments.AzureImageClassificationExperiment.<ExecuteAsync>d__13.MoveNext() in /_/src/Microsoft.ML.ModelBuilder.AutoMLService/Experiments/AzureImageClassificationExperiment.cs:line 69
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Microsoft.ML.ModelBuilder.AutoMLEngine.<StartTrainingAsync>d__30.MoveNext() in /_/src/Microsoft.ML.ModelBuilder.AutoMLService/AutoMLEngineService/AutoMLEngine.cs:line 147

Please include run id AutoML_939342c2-984d-4669-b729-b3129c9a0e1c in the report

End of the training output is:
...
Running AutoML pipeline sweep...
Running AutoML pipeline sweep...
Child run status:Completed: 1, Canceled: 1

Running AutoML pipeline sweep...

Child run status:Completed: 1, Canceled: 1
Completed a training run
Downloading best model to C:\Users\jormont\AppData\Local\Temp\MLVSTools\Redacted_DatasetML\Redacted_DatasetML.Model\bestModel.onnx..
Object reference not set to an instance of an object.

Clicking the "Monitor current run in Azure portal", redirect to an error page:

This says the resource group wasn't found; the model training was successful as the output indicates, so I'm unsure why the same resource group couldn't be found.

This is very old, and I don't think we have a repro anymore. closing.


Support S3 as the persistent storage

Some OLAPs, such as Snowflake, directly use S3 as their table storage, even for the temporary data. It has the benefit to save money for cloud users, additionally, it saves time for data ETL. From this benchmark could we see that S3 based OLAP(Snowflake) does not have a remarkable performance difference with local storage based one(Redshift). There also exists similar projects as Rocksdb-cloud which uses S3 as the Rocksdb's persistent storage, it could be some reference to have ClickHouse been more cloud native.

FYI, we successfully used ClickHouse on top of google cloud storage via gcsfuse.

Does anyone ended up using ClickHouse on top of fuse in long term?

AFAIK:  from roadmap, 2019 Q2 seems to support S3-like object storage, right?

@tangyong that item is not about replacing native storage with S3, it's more about import/export and on the fly processing. Actually this is already partially possible with URL table engine or table function, but it lacks authentication support so it won't work with non-public S3 buckets.

@hagen1778

We are using gcsfuse only for RO purposes
How is performance of such reads? Like how many megabytes per second? Thinking of usage gcsfuse too


Fancy zone quick layout switch bar does not work.

Microsoft PowerToys version
0.71.0
Installation method
WinGet
Running as admin
Yes
Area(s) with issue?
FancyZones
Steps to reproduce

Dragging a window to the sections on the "Quick Layout Switch" Does not work. It does not switch the layout. It basically does no things. After releasing the mouse key it snaps the windows to the zones of the current layout instead of the selected layout.
✔ Expected Behavior
No response
❌ Actual Behavior
No response
Other Software

This quick bar is part of Windows and not FancyZones, which would be why it's snapping to the current layout instead of the selected layout

@cinnamon-msft it was a bug when I reported it. But it seems not replicable in the last version anymore.


Tooltip: enable passing HTML / feature: mouse-over-tooltip

Describe pull-request
Adding slot to Tooltip component so it can wrap other HTML content
Solving issue
Fixes: #AB1022
How to test HTML wrapping

Checkout the branch/PR
Go to tooltip component
In story files, try to add additional HTML in between <sdds-tooltip... > and see if it renders out

How to test move-over-tooltip feature

Checkout the branch or open Storybook in Netlify
Go to tooltip component
Enable mouseOverTooltip prop from controls panel
Now tooltip stay ON as long as you keep your mouse over it

 's are removed now ;)


Update sbt-native-packager to 1.3.21

Updates com.typesafe.sbt:sbt-native-packager from 1.3.19 to 1.3.21.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention @scala-steward in the comments below.
Have a nice day!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [{ groupId = "com.typesafe.sbt", artifactId = "sbt-native-packager" }]

superseded by #27


Just updated to latest now can't use

Iget this error, I've updated via HACS, uninstalled Sonoff integration... restarted
any idea thx
This error originated from a custom integration.
Logger: custom_components.hacs
Source: custom_components/hacs/repositories/base.py:899
Integration: HACS (documentation, issues)
First occurred: 15:18:33 (4 occurrences)
Last logged: 15:18:33
<Integration AlexxIT/SonoffLAN> [init.py] was not downloaded.
<Integration AlexxIT/SonoffLAN> [entity.py] was not downloaded.
<Integration AlexxIT/SonoffLAN> [climate.py] was not downloaded.
<Integration AlexxIT/SonoffLAN> [binary_sensor.py] was not downloaded.

This is error from HACS integration. Not related to this component.

Do I need anything in yaml config bc I have user n pass setup now it says invalid so I commented out. Are there known problems nowadays with HACS bc I keep running in to problems with it. n not just your integration

This can be some network problem

I know it's not ur problem... lol but I figured out the HACS thing... I turned off IPv6 on wifi. Was able download all of integrations no problems. found another HACS post which had it buried.


improving set constant and multiplier in Anchors

#211
keeps following values in setting constant or multiplier

toAttribute
constant
multiplier

Oh... did I make a bug?
Thank you 🙏

i think this is not bug. we just missed adding some test cases. 😉


Replace "Enable batch adding" switch with bottom navigation tabs

A separate tab dedicated to search should also be created

Tested:

separate tab for adding one music interval
separate rab for adding multiple several intervals
separate tab for search

Result: OK


Automatically build and publish cflinuxfs4-compat BOSH release

In order to confirm to Cloud Foundry RFC #16 we need to automatically build and publish a version of cflinuxfs4 that continues to include ruby and python (AKA cflinuxfs4-compat).
The RFC contains more details, but in summary:

This repository is where the BOSH release of the stack should reside
The stack should automatically be published to bosh.io here. We don't have to publish it anywhere else (e.g. we don't have to publish it to GitHub releases on this repository).
We don't have to create build receipts - at least not at this time. It could be a potential future addition.
We should build and publish a new version of the stack every time there is a newly-published release of cflinuxfs4. It should have the same version as the upstream cflinuxfs4 stack.
We do not want to trigger on new versions of ruby or python. We blindly include whatever the latest version of ruby/python packages are available.
We do not need to run CATS, or in fact any testing on this stack.
We have the flexibility to create this automation wherever is most convenient for us - GitHub actions or concourse are both fine.

@robdimsdale do you have a rough estimation when the first version of this stack will be available?

@beyhan sorry about the delay. We've been a little short-staffed recently (and likely will be for a few more weeks) but this is on our priority list. We haven't forgotten. We know this is important to the community.

Notes from meeting 5/31 with @brayanhenao

Add a compat list of stacks to the cflinuxfs4/packages directory
Add a workflow to the cflinuxfs4 repository that is triggered on a release, and creates a compat stack using the compat packages, with the same version as the regular release, and creates a bosh release in this repository

WIP https://github.com/cloudfoundry/cflinuxfs4/pull/7

@beyhan we are actively working on this, I believe a bosh release should be out next week

PR to create the release via GHA : https://github.com/cloudfoundry/cflinuxfs4-compat-release/pull/5

@sophiewigmore thank you for the heads-up. When the release is there I will take care to inform the ARD WG.

While there are releases on this repository, we are still testing the release process and release itself. I'll update this issue when we're more confident in the final result

Workflow:

cflinuxfs4 workflow triggers a repo dispatch with the version when a release is cut to cflinuxfs4-compat-release
cflinuxfs4-compat-release workflow receives dispatch with version information and takes the released cflinuxfs4 images and installs ruby, python, and related packages on top, and then creates the bosh release and releases it to Github

@beyhan @jochenehret @AP-Hunt I believe the releases are good to go now, and should be auto-released everytime there is a cflinuxfs4 release, so I'm closing this out. Let us know if you run into any issues


Add host provider that pulls from remote Core Agent.

Context
Currently, we have a host provider -- AgentLikeHostProvider -- that is meant to emulate the Datadog Agent's hostname resolution behavior. This provider does work, but it has some notable shortcomings in support and changes to the Datadog Agent's hostname resolution logic are still happening on a regular cadence.
It would be good to add a new host provider that instead talks to the Datadog Agent to retrieve the hostname. The Core Agent's internal API already exposes the GetHostname RPC which exposes the same hostname that the Core Agent detects. This would allow us to rely more on the existing logic in the Datadog Agent instead of maintaining parallel implementations of this logic ourselves.

Closed via #368.


Tesla Authentication Changes

Tesla changed their authentication endpoint, which means two things:

Existing tokens continue to work, but can no longer be refreshed
New authentication flow to obtain tokens in the first place.

The current code dumps the existing token if a refresh fails, assuming it will fall back to password authentication.  That's a poor experience, so the short-term fix is to stop doing that.  Longer-term, we'll need to support password-based authentication and MFA.  Expect a couple of PRs:

First, to be more tolerant of failed refreshes, so you get the most life out of existing tokens you can.
Second, to implement the new auth flow with a password
Third, to provide a way to submit an MFA code when authenticating

Also, for anyone stuck on this -- you can still manually provide a token.  I've updated the docs to describe how to do this using an endpoint that already implements the new mechanism.


[STORM-412] Allow users to modify logging levels of running topologies

Thank you @abellina for all the hard work on this.

I had one minor nit, but I am +1 overall with or without the small fix, assuming you can address/answer @Parth-Brahmbhatt's comment.
The test failures look unrelated, one was a failure to bind to a given port, and the other was a kafka failure.

Tested with storm.starter.clj.word_count on a non-secured cluster.  Seems to work. +1

@Parth-Brahmbhatt, thank you for pointing that out that nimbus cleanup thread is not right place for removing ZK nodes for logconfigs. I have moved the zk-node deletion to remove-storm!. Please let me know if you have any other suggestions.

I am still +1 on this.  @kishorvpatil The merge conflict is very minor in the commands list in storm.py, please upmerge.
@Parth-Brahmbhatt I really would like to get this in soon.  Please take a look at the fix so I can pull this in.

+1.

Thanks @Parth-Brahmbhatt @revans2. I upmerged against master. It is ready to merge now.

Still +1


The q4 and after is so hard to understand

I just found that the q4 and after document is so hard to understand, are there any simple explanations about promise's explanation under the hood?

There are many but none of them are illuminating to everyone. Perhaps you will find this one from Eric Elliott useful https://medium.com/javascript-scene/master-the-javascript-interview-what-is-a-promise-27fc71e77261
We have a vibrant community on Stack Overflow.


Check overall ceph versions

Check if there is more than one ceph version in the overall field

when more than one overall field shows, this probably means that is necessary to restart ceph services or manually upgrade a ceph charm

Closes #401

After this patch, a ceph-mon with more than one versions on overall will fail.
E.g:
ubuntu@juju-204e4c-cou-0:~$ sudo ceph versions
{
    "mon": {
        "ceph version 16.2.14 (238ba602515df21ea7ffc75c88db29f9e5ef12c9) pacific (stable)": 3
    },
    "mgr": {
        "ceph version 16.2.14 (238ba602515df21ea7ffc75c88db29f9e5ef12c9) pacific (stable)": 3
    },
    "osd": {
        "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)": 3
    },
    "mds": {},
    "overall": {
        "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)": 3,
        "ceph version 16.2.14 (238ba602515df21ea7ffc75c88db29f9e5ef12c9) pacific (stable)": 6
    }
}

Running COU will fail with the following message:
Would you like to start the upgrade? Continue (y/N): y
Running cloud upgrade...
Ensure that the 'require-osd-release' option in 'ceph-mon' matches the 'ceph-osd' version ✖
2024-05-07 18:32:14 [ERROR] Ceph applications are on mismatched releases:
{'ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)': 3, 'ceph version 16.2.14 (238ba602515df21ea7ffc75c88db29f9e5ef12c9) pacific (stable)': 6}.Please manually upgrade or restart ceph services to have a single version.
2024-05-07 18:32:14 [ERROR] See the known issues at https://canonical-charmed-openstack-upgrader.readthedocs-hosted.com/en/stable/reference/known-issues/

I didn't have time to finish this PR before my vacation. The idea of this last commit is to validate the ceph-osd configuration before upgrading ceph-mon which is the first ceph component for a target (all ceph units should have the same track as the expected for the current workload version) and after upgrading ceph-osd which is the latest ceph component (all ceph components should have the same track as the target)

It's on the tracking board for a while
If we do not have time to finish this one, do you mind to close it?
We can reopen it when we are available again.

Closing the PR. This should be handled later


Correction for raw affiliation Ecole Normale Supérieure de Lyon; CNRS UMR 5276; Lyon France

Correction needed for raw affiliation Ecole Normale Supérieure de Lyon; CNRS UMR 5276; Lyon France
raw_affiliation_name: Ecole Normale Supérieure de Lyon; CNRS UMR 5276; Lyon France
new_rors: 04zmssz18;02feahw73;04t89f389
previous_rors: 04zmssz18;02feahw73
works_examples: W2052885895
contact:<PHONE_NUMBER>b9eaca414f8253b28f9345:550a0254b1e39e460da3c5ed93dd @ ens-lyon.fr

This issue was accepted and ingested by the OpenAlex team on 2024-12-19. The new affiliations should be visible within the next 7 days.


Split Optics Into A New Framework?

I think it would be worth it to make optics (and their underlying Indexed monads and comonads) their own micro-framework.  They already rely so little upon primitives in Swiftz and Swiftx, and we're not treating them like first-class citizens enough, to the point it doesn't make sense to keep them part of the larger repo.

I tried to (github) (file) search for "optics" and "optic" and didn't find anything. I don't know much, so which files are you talking about?

Our little lens hierarchy and anything with an Ix in it.

I'd be OK with maintaining them separately, if we do decide to split them out.

@pthariensflame I think now is the time to do it, especially with the Swift 2.0 changes going into a new release.  Got a name?  Lens, Optics?

Well, lens is already taken in Haskell, and I'm using refraction and TeaLeaves for my WIP ports to Rust and Ceylon, respectively.  My attempt at one for Scala (before Monocle existed) was called Lentil…
How about Bifocals?

Focal.framework has a nice ring to it.

Or, rather than the awkward adjective, how about Focus?

RefractiveCocoa :trollface:

/cc #216

:warning: Executive decision made :warning:
#216 will be assimilated into Focus.framework


How to track regular operations task

This is linked to  a document Rodrey wrote before he left
https://docs.google.com/document/d/1jfCClZ8gfNxOWZSPzj9xr1tx99-C9d8Lpcw_G85yvL8/edit
and the operations tasks listed in https://ebi-ait.github.io/hca-ebi-dev-team/operations_tasks/operations_tasks.html
I would like the table in the operations notes updated with what the regular tasks are, and how frequently they should be run
https://docs.google.com/document/d/1O2nCBtnFY-AWh_1_s188xLTyvaZpwbUUp3Pvs_aV_jc/edit?ts=5f1816b8#heading=h.1c86hlw8cv82

Thans Laura - hadn't seen the document.
I had started a branch to document all this as well as some e2e tests and will copy the tasks into that table.


Save Data Errors out in Firefox

It shows a completed popup and silently (in the console) fails.

At the very least, the "success" message during failure is really not great.
This seems to happen when there are players/traits/etc and not just editing the main text / general info

Missing await keywords
Fixed in d6194df69f8b97ec86f3849374abc604c8cc7cbd


initial unet recon demo commit

Signed-off-by: mersad95zd<EMAIL_ADDRESS>Fixes # .
Description
This PR contains a demo to perform training/validation with U-Net for accelerated MRI reconstruction.
Status
Ready
Checks

[x] Notebook runs automatically ./runner [-p <regex_pattern>]

I was wondering if you could:

Add workflow figure to explain the recon algorithm. Current one is too simple.
Add training/validation curve, so the users can know whether their performance is normal or not.
Report inference result in readme, and compare with leaderboard to show that this implementation gives reasonable result.

Thank you!

Thanks.
Could you remove the model pt? We will put it in model-zoo in the future, not in the tutorial.
I was not sure whether this golfer should be called 2d_reconstruction, since it works on the 2D slices of 3D volumes. Would it be better to put them in folder reconstruction/MRI_reconstruction/?

Looks good to me. @wyli Could you help final check it?


Improve output on build error

Hey Mattt,
Most issues submitted here are regarding build errors, which are quite often caused by simple code signing issues. The problem I see is the information provided if the build failed.
Some example outputs when there are code signing issues:
ipa build

Configuration was not passed, defaulting to Debug
     xcodebuild  ProductHunt.xcodeproj
** BUILD FAILED **

The following build commands failed:
	Check dependencies
(1 failure)
** ARCHIVE FAILED **

Of course, that's not helpful and doesn't provide any information about the root of the problem.
When running --verbose, the shown information is pretty useless, as xcodebuild just fills up the screen.
I piped the output when using --verbose into a file. The important bits in case of a code signing error are shown right on the top of the output:
=== CLEAN TARGET App OF PROJECT App WITH CONFIGURATION Release ===

Check dependencies
[BEROR]Code Sign error: No code signing identities found: No valid signing identities (i.e. certificate and private key pair) matching the team ID “MGTRPU24” were found.
[BEROR]CodeSign error: code signing is required for product type 'Unit Test Bundle' in SDK 'iOS 8.1'

@mattt I don't know how you'd approach this solution, but having an output similar to xctool or xcpretty would be a good first step. I also run into code signing issues for new projects and it's a tedious thing to debug in shenzhen right now.
I remember you mentioning, you don't want any dependencies to xctool or xcpretty, which means, we'd have to roll our own solution.
If you agree, I could prepare a pull request, improving the error handling. This would really improve the quality of this library :+1:

+1

Just a small update from my side: fastlane now uses xcpretty to properly render the xcodebuild output and its error messages, with this commit: https://github.com/KrauseFx/fastlane/commit/32c9f37722cc1b008673bd7357f38170dada62ac?w=true

Closing in favor of gym


I Dont see any python sdk version that supports ops-agent installation or yaml file to install

I would like to know, is there any sdk version that supports installation of ops-agent
Can i get an yaml file that support os policy assignment, to install ops-agent for all the supported OS.

Hey @gnsharans,

Python SDK is not required to install the Ops Agent on individual VMs; if you are using the gcloud command, please check the gcloud cli installation instructions for the required Python version.
Please check our instructions on managing agent policies for managing installation for a fleet of VMs; Other installing methods are also available.

Feel free to reopen this if further assistance is needed!

Thanks @LujieDuan.
python sdk with proper method to create ospolicy and apply ospolicy helped to resolve this.


Fix docs to include ecr:PutLifecyclePolicy

The documented policy is not complete. Added the missing ecr:PutLifecyclePolicy.
I also sorted the policy names so they look nicer.
Also ran pre-commit and that changed some stuff.

@oliverisaac Thanks for fixing this up! 👍🏼


DPG, fix wrong requestbodyschema javadoc for binary schema

Fix https://github.com/Azure/autorest.java/issues/1494

issue created for wrong response type of binary response body:
https://github.com/Azure/autorest.java/issues/1542


Increase resolution of Draw.io diagrams

Describe the feature you'd like
Draw.io diagrams should be generated at double the resolution.
Describe the benefits this would bring to existing BookStack users
This will make diagrams look nicer on HiDPI devices. Currently, they look a bit blurry, notably the fonts. This may also be noticeable on regular displays.
Can the goal of this request already be achieved via other means?
Another possibility would be to render them as SVG (see #1170). As we don't need them to be interactive, they can be rendered in <img> tags (but this does not solve all the problems reported in #1170).
Have you searched for an existing open/closed issue?

[X] I have searched for existing issues and none cover my fundemental request

How long have you been using BookStack?
0 to 6 months
Additional context
No response

As a proof of concept, I tried this patch:
diff --git a/resources/js/services/drawio.js b/resources/js/services/drawio.js
index 67ac4cc0ecb3..4b1389afa6df 100644
--- a/resources/js/services/drawio.js
+++ b/resources/js/services/drawio.js
@@ -55,7 +55,7 @@ function drawEventExport(message) {
 }

 function drawEventSave(message) {
-    drawPostMessage({action: 'export', format: 'xmlpng', xml: message.xml, spin: 'Updating drawing'});
+    drawPostMessage({action: 'export', format: 'xmlpng', scale: 2, xml: message.xml, spin: 'Updating drawing'});
 }

 function drawEventInit() {
diff --git a/resources/js/wysiwyg/plugin-drawio.js b/resources/js/wysiwyg/plugin-drawio.js
index 9f4a065adf86..57fbb9629795 100644
--- a/resources/js/wysiwyg/plugin-drawio.js
+++ b/resources/js/wysiwyg/plugin-drawio.js
@@ -26,7 +26,7 @@ function showDrawingManager(mceEditor, selectedNode = null) {
                 pageEditor.dom.setAttrib(selectedNode, 'drawio-diagram', image.id);
             });
         } else {
-            const imgHTML = `<div drawio-diagram="${image.id}" contenteditable="false"><img src="${image.url}"></div>`;
+            const imgHTML = `<div drawio-diagram="${image.id}" contenteditable="false"><img src="${image.url}" style="with:50%;height:50%;"></div>`;
             pageEditor.insertContent(imgHTML);
         }
     }, 'drawio');

It does not work:

draw.io seems to ignore the "scale" parameter (I have looked at the source code to find it, but I am a bit unsure)
the style attribute is not applied (but maybe there is some sanitizing?)

I'll investigate more later.

Thanks @vincentbernat.
I remember having a quick play with this a while back.
Just to confirm, are you building the JS via the npm commands upon source change? The sources are not used directly.
I have it in mind that the export size change is simple (Just the scale change as you've set) but juggling the dimensions is tricky. Ideally you'd want to set actual height/width attributes on the images of the correct original (half-image-file-dimensions after 2x scale) sizes. I think width/height via styles are going to be relative the the wrapper/parent el, so not really viable. You can scale via transforms but that's really a hack, and not a direction I'd want to go since it'll have other offset affects (blurriness, portability).
Should be do-able but would require storing and/or query of image dimensions at multiple stages (Insert, Edit, Replace etc...), complicated a little further with back-compat in mind.

No, I didn't rebuild the JS. I'll try that.
I know that transform won't work as it will leave the space blank. This SO question contains various solutions that could be tested: https://stackoverflow.com/questions/8397049/how-can-i-resize-an-image-to-a-percentage-of-itself-with-css.

Does bookstack have the ability to apply an XML config? If yes, we can add a config option for default PNG resolution.

Thanks @davidjgraph!
I have just tested this though, and the scale option on the export postMessage seems to work fine and as I'd expect, so not sure we'd specifically need the extra option to change the default, so please don't spend time on that on our account since it's not needed unless I've misunderstood something.

FI, since my instance of BookStack was empty, I just switched from xmlpng to xmlsvg and image/png to image/svg+xml, modify extension for storing images to .svg and it works fine.

I realised this is already open under #3743 so I'm going to close this off as a duplicate.


Route support for OpenShift deployments

Added support for Route object to be used in case of OpenShift deployments instead of Ingress.
Changes:

route.yaml in templates
new section in values.yaml
updated Notes to get the route URL

Based on previous comments:
Restored default settings in values.yaml. Set default to not create route. Bumped version to pass tests.

Hi @gasgithub ,
can you rebase and bump the chart version once more? after that i can merge your PR

Thanks all.
From: Tobias Trabelsi @.>
Sent: Friday, August 20, 2021 9:52 AM
To: SonarSource/helm-chart-sonarqube @.>
Cc: Oruganty, Chandrasekhar @.>; Comment @.>
Subject: Re: [SonarSource/helm-chart-sonarqube] Route support for OpenShift deployments (#49)
Closed #49https://urldefense.com/v3/__https:/github.com/SonarSource/helm-chart-sonarqube/pull/49__;!!IBzWLUs!Dggfda-RMbfRT83nAbklbE0obOFvO3blbhkIkBk4_vlRT-78wPyXRmbZbNUidgmf$.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/SonarSource/helm-chart-sonarqube/pull/49*event-5186951895__;Iw!!IBzWLUs!Dggfda-RMbfRT83nAbklbE0obOFvO3blbhkIkBk4_vlRT-78wPyXRmbZbHDzCt83$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/AORQHC6GPI5TGERMZP3VOXTT5ZMWTANCNFSM476QBDCA__;!!IBzWLUs!Dggfda-RMbfRT83nAbklbE0obOFvO3blbhkIkBk4_vlRT-78wPyXRmbZbL1i5fnF$.
Triage notifications on the go with GitHub Mobile for iOShttps://urldefense.com/v3/__https:/apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675__;!!IBzWLUs!Dggfda-RMbfRT83nAbklbE0obOFvO3blbhkIkBk4_vlRT-78wPyXRmbZbHlef_ql$ or Androidhttps://urldefense.com/v3/__https:/play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email__;!!IBzWLUs!Dggfda-RMbfRT83nAbklbE0obOFvO3blbhkIkBk4_vlRT-78wPyXRmbZbCoOXbCA$.


Not Properly Scrolling Anymore in iOS7

When test my app for the upcoming iOS7, I noticed that the scrolling to the active text field no longer works.
I tried just testing the supplied Example.xcodeproj to ensure it was not something funky I was doing.
The Example project worked fine when running in the iOS6 simulator.  I can navigate to the all the fields back and forth, using the next and previous buttons.  The view is scrolled and focused properly.
However, when I run this on the iOS7 simulator, I can navigate to the first few fields fine in the Example project.  When I get to the "Your favorite food?" field, pressing the "Next" button, scrolls the view to the top - showing Username, Password, etc... but cursor is in "Your favorite movie?" field behind the keyboard.  In my app, the same thing is occurring.
I believe the problem is in the scrollRectToVisible and the iOS7 keyboard.  I know this is probably not a problem with this great control - but it will "break" the Example once iOS7 is released if there is not a fix with Apple or another workaround.

This fix doesn't fix the scrolling issue.


remove dependencies and add css for datatable.

removed these dependencies

angular-datatables
datatables.net
datatables.net-dt

added CSS for the DataTable in HelpComponent.

Thank you very much for the PR.
Can you please move the css code directly into the .scss file as @dominikriemer mentioned.

Thanks for the update! I had a look at the PR and have some minor comments:

Did StreamPipes start for you?

I had to remove "node_modules/datatables.net/js/jquery.dataTables.js" in the file angular.json

The fields tab looks good but the table in live preview still has the old dataTable CSS class.

You can find the implementation in the component PipelineElementRuntimeInfoComponent
Can you please update this component as well?

Please also merge the latest version of the dev branch into your PR, sinc we fixed the tests there yesterday.

sure. i will do that

i was adding some css to the preview.component but it is not working .That changes worked in HelpComponent.

Did you add it to this file? ./pipeline-element-runtime-info.component.scss
The table for the priview should be located in connect/components/runtime-info/pipeline-element-runtime-info.component.html

review please

Thanks a lot, I'll have a look at it

@yash013 thanks a lot for your work so far 🙏🏼
It looks like you haven't set up the pre-commit hook for our UI.
You can read here how to do this: https://github.com/apache/streampipes/blob/dev/ui/README.md

@yash013 are you still working on this PR?
Otherwise, we will take over it or even close it
In case you want to pick it up somewhen, you can always just reopen it

Actually I'm very busy in some other business project
I will surely complete that whenever I get time. For now I'm not working on this pr hope you understand.

Sure, no problems :)
Just wanted to keep up with our PRs


Native window.print() dialog is not handled

Are you requesting a feature or reporting a bug?
bug
What is the current behavior?
system print dialog appears and prevent test execution
What is the expected behavior?
this dialog should be handled
Provide the test code and the tested page URL (if applicable)
<html>
    <head>
    </head>
    <body>
        <button onclick="window.print()">print</button>
        <button>click</button>
    </body>
</html>

Test code
test('Print dialog', async t => {
    await t
        .click(Selector('button').withText('print')) // waiting here and prevents further test execution
        .click(Selector('button').withText('click')) //
});

Are you requesting a feature or reporting a bug?
bug
What is the current behavior?
system print dialog appears and prevent test execution
What is the expected behavior?
this dialog should be handled
Provide the test code and the tested page URL (if applicable)

print
click

Test code
test('Print dialog', async t => {
    await t
        .click(Selector('button').withText('print')) // waiting here and prevents further test execution
        .click(Selector('button').withText('click')) //
});

Is there any update on this issue?

Hi @ZayanNadeem
The current development sprint is already planned. We will consider this issue during planning the next development sprint.

Any update on this?

Hi @weyert
At present, this enhancement is not implemented.
The features that we are planning to implement are listed on the Roadmap page. The current feature is not on this list. I'm afraid I cannot provide you with any time frames as to when it will be implemented.
If this enhancement is very important for you, the PR is greatly appreciated.

Hi, I'm just wondering if an issue I'm experiencing is related to this.
Running my tests in Safari, and I get a browser dialog/pop-up window: this website has been blocked from automatically composing an email. I've tried to use await t.setNativeDialogHandler(() => true), but I'm unable to clear the dialog. This then prevents the rest of my tests from executing (as referenced here).

The setNativeDialogHandler method is intended for the native alert/confirm/prompt and beforeunload dialogs. It does not support the print dialog (as mentioned in this thread) or other dialogs. We will look deeper into it in the context of your other thread: #4732

Hey, can you leave this open, please?

Hello @rob4629,
OK.

hi
any update on this issues?
i have same problem
i want to be sure that button is working correctly but when i click on the button print dialog comes out and i can not do any thing with that :|

Hello, I'm experiencing the same problem. The print window is opened and the browser hangs and eventually closes down.
Do you have any workarounds for this? The submit button doesn't have an onClick attribute.

Hi @kerrijackson,
There are still no updates. However, you can use the following workaround to prevent test execution from being stopped. Add the following code to clientScript.
window.print = function () {};


Added basic interaction in the website......

I have added js file with basic interaction to the website. as it was  asked in #3

Nice work


Dialyzer fixes for oc_chef_authz_acl

:+1:

:+1:

Looks good other than my one comment.

@jd Seems you are still working on this branch.  Is the plan to hold off on merging it until the dialyzer work is done?  Wondering if I should submit a PR for the small dvm fix separately.

@stevendanna You meant @joedevivo I guess :)

:+1: This makes me very happy to see.

OMG as an added bonus, warnings_as_errors is back on!

Hells to the yes dude. :100:

:doughnut: :hamburger:


Add custom font

Version of embedded-graphics in use (if applicable): 0.7
Target: real hardware
If using real hardware: Waveshare epaper 4.2"

Please link to the driver on https://crates.io if applicable.
Adding custom font
I would like to use helvetica bold font but i can't figured out how to export .raw file to import it in code as seen in example :
https://github.com/embedded-graphics/examples/blob/main/eg-0.6/examples/text-custom-font.rs
I there any documentation to do so ?
Test case (if applicable)
// Failing test case demonstrating the issue here

Thanks
Simon

I there any documentation to do so ?

No, unfortunately there isn't any documentation on creating font images for use with MonoFont.
I've recently resumed working on adding support for BDF fonts to embedded-graphics. This should provide a more accurate display of Helvetica, because the new text renderer supports proportional fonts. And it will also contain some tooling to make it easier to convert BDF fonts into images for MonoFont.
But until that is available I've created some monospaced versions of Helvetica, which are based on the xorg BDF files at https://gitlab.freedesktop.org/xorg/font/adobe-100dpi.

Download: helvetica.zip

Thanks, i successfully run your example, i will use your exported font for my project.
Have a good day

I'm sorry to add comment on a closed issue, but i have tried to convert myself the bdg to .raw and .png file and i can get the same .raw file md5sum, and the font did not display as it should on screen
I use the following with the .bdg file in xorg repository linked
cargo run helvB10.bdf helvb10 --png helvb10.png --raw helvB10.raw
Could you give the command used to generate .raw and .png file ?
Thanks
Simon

I'm sorry to add comment on a closed issue,...

No problem, but I would prefer if you reopen the issue if the problem reappeared. I think you should have the permission to do so if you closed the issue yourself, otherwise ignore what I said.
I did use a new font converter, which isn't released yet. But I noticed a bug in bdf-to-mono, which I hadn't used in a long time. Try to convert the font using the fixed version in #672.

Thanks, md5 match now :)
In fact i have tried to perform the conversion myself to generate the .raw file for helvB08.bdf  font, which is generate the following assert error :
simon@simon-msi:~/rust/embedded-graphics/tools/bdf-to-mono$ RUST_BACKTRACE=1 cargo run ~/Téléchargements/helvB08.bdf helvB10 --png helvB08.png --raw helvB08.raw
    Finished dev [unoptimized + debuginfo] target(s) in 0.04s
     Running `/home/simon/rust/embedded-graphics/tools/target/debug/bdf-to-mono '/home/simon/Téléchargements/helvB08.bdf' helvB10 --png helvB08.png --raw helvB08.raw`
thread 'main' panicked at 'assertion failed: `(left == right)`
  left: `-1`,
 right: `0`', bdf-to-mono/src/lib.rs:128:9
stack backtrace:
   0: rust_begin_unwind
   1: core::panicking::panic_fmt
   2: core::panicking::assert_failed_inner
   3: core::panicking::assert_failed
             at /home/georgik/projects/rust/library/core/src/panicking.rs:138:5
   4: bdf_to_mono::MonoFontData::new
             at ./src/lib.rs:128:9
   5: bdf_to_mono::main
             at ./src/main.rs:32:18
   6: core::ops::function::FnOnce::call_once
             at /home/georgik/projects/rust/library/core/src/ops/function.rs:227:5
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Is there a minimum size for a font ?
Thanks
Simon

This happens because helvB08 is a proportional fonts and some glyphs overlaps the origin to left. bdf-to-mono was designed for fonts with equally sized bounding boxes with no overlap to the left.
The conversion should work if you comment out the assertion in line 128 of lib.rs, but this will crop one column of pixels from some glyphs.


information window not closed

DBeaver 7.3.3
Postgresql 12
Execute SELECT command in SQL Editor.  This command contained error "select * from sch.tytle;"   sch.tytle it is wrong name of table, correct name is sch.title.
Query executing for the long time and show this window

after i click on "No" "Нет" this window opens again and again until i click "Да" "Yes"

duplicate of https://github.com/dbeaver/dbeaver/issues/10101

duplicate of https://github.com/dbeaver/dbeaver/issues/10101

Thank you for the report. Will be fixed in #10101

Thank you for the report. Will be fixed in #10101


Nodes are not correctly split after a multiline comment

This text:
Test
 Test 2
  Test 3
 Test 4

/*
Multiline Comment
*/

Test
 Test 2
  Test 3
 Test 4

Will result in this graph:

Thanks for finding this. Going to work on a fix right now.


Default qualifier to alpha1 and fix workflows

Signed-off-by: Peter Zhu<EMAIL_ADDRESS>Description
Default qualifier to alpha1 and fix workflows
Issues Resolved
#258
Check List

[ ] New functionality includes testing.

[ ] All tests pass

[ ] New functionality has been documented.

[ ] New functionality has javadoc added

[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

https://github.com/opensearch-project/ml-commons/runs/5775953726?check_suite_focus=true
IT failed
org.opensearch.ml.rest.RestMLDeleteModelActionIT > testDeleteModelAPI_Success FAILED
    java.net.ConnectException: Connection refused
        at org.opensearch.client.RestClient.extractAndWrapCause(RestClient.java:922)
        at org.opensearch.client.RestClient.performRequest(RestClient.java:307)
        at org.opensearch.client.RestClient.performRequest(RestClient.java:295)
        at org.opensearch.test.rest.OpenSearchRestTestCase.initClient(OpenSearchRestTestCase.java:207)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:568)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:972)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)

        at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:44)
        at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
        at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:[60](https://github.com/opensearch-project/ml-commons/runs/5775953726?check_suite_focus=true#step:9:60))

Expected failure on the build as the docker image itself does not have security and pa plugin.

The pulling mechanic is running well now as well as installation.

Expected failure on the build as the docker image itself does not have security and pa plugin.

Thanks, but if no security plugin, we should run IT in security disabled mode, that should pass. Will do some test by running docker locally.

Seems flaky, rerun and see JDK 17 passed


Remove the horizontal scrollbar

The horizontal scrollbar still appears on all the devices. As per I conceive, the Google Form is causing the trouble.
Possible solution: Replace the position of Google Form and the image.

I'd like to work on this issue.

Sure
On Tue, Apr 23, 2019, 10:42 AM shreyarastogi<EMAIL_ADDRESS>wrote:

I'd like to work on this issue.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/zero-gravity-org/zero-gravity-website/issues/32#issuecomment-485646248,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ACTSEPCNEM6HFDAMWFPBJL3PR2LFFANCNFSM4HHRF5HQ
.

where can I get the code for this problem, is it in the develop branch?

Yes, it is in develop branch.

Yes, it is in develop branch.

Sahil, your PR does not solve this issue.

Hey! @sahilit have you solved this issue?

Hey @shreyarastogi
The issue is solved now.
You can check this #29 pull request where I have committed the code for fixing the issue.

Shreya, aren't you a mentor?


avoid retries for 401 and 403 HTTP errors in cloud API requests

Currently the plugins calling the cloud APIs are retrying all failures. But the permanent errors must not be retried.

[ ] Disable retries for 401 and 403 errors
[ ] Log request and responses sent and received from Huaweicloud APIs by the SDK.

I will take it

@swaroopar The task about log already done in https://github.com/eclipse-xpanse/xpanse/issues/1673
Just change the default value false to true of item huaweicloud.sdk.enable.http.debug.logs

@baixinsui ah ok. That's good. Then we implement only the first requirement.


ENH: add mypy plugin for more precise ufunc signatures

Keeping this as a draft as it needs discussion (if we decide its ok I'll need to add more data on ufunc arities to the plugin).
This adds a mypy plugin that alters ufunc signatures to have the correct arity at type checking time. The tl;dr version is:
np.sin(1, 1)  # Ok on master, but fails with this plugin

The broader issue is:

ufuncs are all instances of the same class
but their arities differ
there's no way to capture that in the current type system

To work around that, the plugin lets us halt each time a numpy.ufunc.__call__ node is reached in the AST and modify the signature. This just does arities, but you can imagine that when ndarray is generic over dtypes then we can potentially do even fancier things like adding overloads for all the appropriate dispatches for the ufunc.
Now, I imagine one concern people might have is "doesn't this lock us into mypy", and the answer is "not really". The plugin is purely opt in-you have to include it in your mypy.ini for it to be activated. So we can easily have the stubs, which describe things as best they can, and a set of plugins that give more precise types for people who happen to be using mypy.
Thoughts?

Interestingly, PEP 612:
https://www.python.org/dev/peps/pep-0612/
might also allow us to better type ufuncs by making the ufunc class generic over a parameter specification.

And here's a branch
https://github.com/person142/numpy-stubs/tree/ufunc-plugin-with-literal
with a plugin that abuses Literals to allow you to specify ufunc arity by doing something like
from typing_extensions import Literal

sin: ufunc[Literal[1], Literal[1]]
           ^           ^
           nin         nout

So I guess we've got some options:

Include the ufunc arity data in the plugin itself

Pretty tame
Can't handle non-NumPy ufuncs
Not very DRY

Import NumPy in the plugin

Maybe a little sketchy
Can't handle non-NumPy ufuncs
For some reason fails on 3.7 in CI (but works in 3.6 and 3.8, so might be a bug elsewhere)

Abuse literals

Pretty out there
Can handle non-NumPy ufuncs

My main concern is that we really should have a solution that will work also for other libraries, and while importing numpy is possibly fine, we should maybe not force the library to do the same?
I am still curious if we cannot do the plugin solution anyway, but provide a way to "expand" the ufuncs, if necessary by telling projects how to create a very simply plugin themselves? The literal solution seems fine, although having Literal in there seems a bit ugly?

Closing this; it was a good experiment with plugins (I think I feel more confident that they will be a big part of supporting types in NumPy), but it's not really "production grade".


Reduce size of WMArchive docs

Impact of the new feature
We identified that recently WMArchive starts slowing down due to increased load introduced by FWJR/CRAB streams with large document sizes. In particular, we found that adding run/lumis information into WMArchive doc significantly increases its size. The impact on WMArchive service was reported by Jen A. and it slows down data look-up on the WMArchive interface. Then, we got report from the CERN MONIT team who claimed that WMArchvie docs fill out the Kafka pipeline with large docs and cause infrastructure interruptions. In particular, they reported seeing WMArchive docs of 30MB in size. Please note, the Kafka is designed to process millions of small size documents and shared among different experiments.
Is your feature request related to a problem? Please describe.
Yes, it affects WMArchive service and MONIT infrastructure.
Describe the solution you'd like
I suggest we should reduce WMArchive doc size either by eliminating run/lumi info completely (since it is present in DBS) or using a compact format such as lumi ranges.
Describe alternatives you've considered
Drop large documents above a certain size in WMArchvie/MONIT. Currently, I added 10MB threshold in WMArchive to drop docs which it supposes to send to MONIT if their size goes above it.
Additional context
This is somewhat critical since data-ops (Jen A) heavily rely on WMArchive service.

Valentin, thanks for creating this issue. By a quick look at the code and the history, I think the function to be changed is this one:
https://github.com/dmwm/WMCore/blob/master/src/python/WMCore/Services/WMArchive/DataMap.py#L132
From your last email, I'm also not sure how important this information is. I agree, providing only the total number of lumis and events per run should suffice.
@khurtado Kenyi, if you have free cycles to look at this issue by Monday, please do so and I can help you validating it. Otherwise I'll try to work on it on Tuesday.

yes, this function will do the trick, but we should be very careful to not break the WMArchive schema. The schema we use has this structure:
'runs': [{'lumis': [164, 165], 'runNumber': 160960}]}],

Therefore, once you made a change please ensure that you'll not break the schema, otherwise the data transformation from JSON to Avro data-format will fail. Avro is schema-based data-format and can't change it w/o breaking backward compatibility. Therefore we should provide lumis as list (even it will be one number).

So, my question to you and @belforte Stefano is, which option is the best:
a) provide the total number of lumis in the input/output files and an empty list for the eventsPerLumi, e.g.: ...'lumis': [500], 'eventsPerLumi': []...
b) or simply set both of them to empty lists
?
Clearly a range of lumis is no longer possible because we cannot meet the data schema.

I have a few things to say:

no backporting to a CRAB branch is needed, we build on top of latest WMCore tag
this is not something we can hurry. From the time a new CRAB TaskWorker is deployed, change
will only affect new submissions. Tasks already in the system keep using old code and will only
disappear fully after a month.
I do not know about WMA timeline on that, can they really  patch all running agents
w/o disturbing operations so that changes are pushed quickly enough to justify
putting this item at top of all priorities ?
Since we have been running with this code for years, I can't see the urgency.
Can we simply delay migration to  Kafka feed until we are ready and keep sending
data to HDFS as before until summer. This does not mean doing nothing. It is simply
the natural timeline of the development/deployment cycle.
I am confused as to the goal  of this WMArchive project. IIUC it is a long term archive of
summaries for later analytics which nobody is doing at the moment, hence the lack of
clarity on what's actually needed.
Unless someone knows better, my take on 5. is that we should not persist for
posterity detailed list of lumis and/or event per lumi. And rather we should think
how to avoid the event-level bookkeeping to become a problem in Run4 and beyond.

So I vote for  empty lists !!

Stefano, let me answer a few of your questions.
4. we run WMArchive for years, but only recently CRAB docs were added which contribute to the problem. Please note that WMArchvie consumes O(M)/day and puts them to HDFS. These docs are stored in MongoDB before migrating them to HDFS. As such when we added a new source (CRAB) we mostly double the load. Jen A. reported that recently  WMArchive web interface starts behaving poorly and my research on this subject was that it is due to large docs which we aggregated in Mongo. Therefore I proposed to migrate WMArchvie to MONIT to take advantage of the common infrastructure. Turns out that these large docs cause issues in the Kafka pipeline which designed to consume mostly small docs. In any case, WMArchive web UI is a custom app and we are In favor of replacing it using MONIT dashboards.
5. WMArchive is an archive, but the data-ops team uses it extensively to spot various problems with failures on different sites. We also use WMArchive to troubleshoot the problems and find logs of failed jobs. I don't recall that we ever used WMArchive to run/event/lumi studies though. The WMArchive schema was proposed by the DMWM team and I followed it with WMArchive implementation.
Therefore since I also don't know any use cases for run/lumis usage I suggest using empty lists for them.

@vkuznet sorry,  I wrote before I fully read the situation and just edited my comment to remove things which are fully wrong, useless, stupid or worse (I hope). I will now read your reply.

OK. sounds like we agree. Actually CRAB was sending data to WMArchive for a year or so, then it stopped during SL6/7 migration and looks like we resumed after the reports had got larger. I see no problem in taking CRAB stream off until we are sure that all jobs report with the new format. I apologize again for having written w/o fully understanding. A side effect of working from home with kid at home.

Valentin, has WMArchive completely migrated to the MonIT infrastructure? Since when?
I'm trying to evaluate the real impact on the MonIT infrastructure and/or if there are any other options besides running with this among many other items on our plate. Even though the change is meant to be trivial...

Alan, I added support to inject WMArchive data into MONIT a long time ago. But due to the misconfiguration of credentials, we didn't send data until recently. When I identified the issue I worked with MONIT team to establish WMArchive data stream and now it is fully functional, see [1]. The WMArchive data now are fed into ES and landed on HDFS [2]. But these also complement the original WMArchive HDFS location [3] which stores WMArchvie data in Avro format according to our schema. The data in [2] are stored as JSON, therefore, in principle, we can adjust the schema once this issue will be resolved, and eventually, we can simplify WMArchive service to only feed data to MONIT.
Therefore, the migration to MONIT is not yet complete, but it is fully functional. Once we'll have full data flow, we can work on setting up dashboards from ES and use grafana instead of WMArchive custom web UI. Once this is complete, I can re-factor WMAchive code and drop local MongoDB, custom web UI, and potentially completely refactor (or re-write) WMArchive to be independent from WMCore and serve only as a proxy between WMA and MONIT where all data will be fully handled by MONIT infrastructure.
[1] https://monit-kibana.cern.ch/kibana/goto/cf4d7e3824487359262edaf6185b8e6f
[2] /project/monitoring/archive/wmarchive/
[3] /cms/wmarchive


test: extended test coverage :

flag for slow test vs acceptance tests
tests for odd image dimensions
tests for filepattern option

Tests on odd dimensions images are failing.


Handle tombstone records in offset tool

In order to support the ability to delete offset entries in the Mirus configured offset topic, the offset tool should be able to handle offset entries of null. Kafka will eventually delete records in a compact topic that has the same key value of a tombstone record. This deletion doesn't happen instantly and depends on different configuration settings.
An outcome of this feature of handling null offsets is the ability of a consumer application, such as an offset checker, to have offsets of partitions of a deleted topic marked with a tombstone record and therefore filtered out.

@pdavidson100  on another note, seeking to offsets seems to happen only on-startup, correct? I reset the offset of a certain topic/partition in the __ajna.replikator-offsets topic but didn't see Mirus replicating the messages until I restarted the tasks through the API.  Just wanted to confirm that this is expected as this what I read from the KC source for WorkerSourceTask class.

@dalassi1 Yes, that's expected.


Automated version bump through renovate

This PR serves 2 purposes

Dependency updates for the current build to be compatible with the latest grpc-java rule
Add renovate (must be configured through maintainers) to handle automated dependency updates in future through PR flows.

The PR needs to be rebased before I can land it, however

This appears to be an automated process, and it needs to be rebased. Closing, assuming that the next PR will be from HEAD of main


Column not found: 1054 Unknown column 'relevance' in 'having clause'

Just installed the trait, did a basic search:
php $files = File::search($input['query'])->paginate(10);
First a PDO Exception:
PDOException in Connection.php line 288: SQLSTATE[42S22]: Column not found: 1054 Unknown column 'relevance' in 'having clause'
QueryException in Connection.php line 620: SQLSTATE[42S22]: Column not found: 1054 Unknown column 'relevance' in 'having clause' (SQL: select count(*) as aggregate from filesgroup byfiles.id having relevance > 5.75)

Did you declare the search columns in the model?

@nicolaslopezj It's not related to search columns,
when we try to use paginate() on the search() object this exception will occur ...
thanks.

Is this not fixed with #35?

Im getting the same as well.
Column not found: 1054 Unknown column 'relevance' in 'order clause'

database.php mysql  strict => false


feat: do not suggest barrel files for import

Current dependencies on/for this PR:

main

PR #162   👈

This stack of pull requests is managed by Graphite.


issue #173 expose versions alternative1

I suggested an enhancement, but after reading the contribution guide I've decided to implement it myself in three flavors (so you can decide which is better, and eventually merge). All of them are tested.
This one is perhaps the most simple one. I've just added 5 constants into Uuid class, and tests for them.
Thx

Change request is done

Thx for accepting my contribution. I've learned a lot with this well curated and tested package.


CORE: Propose and implement a method to sync the cell count between the verilog file and the C++ file.

Currently, the cell count is hardcoded (32 cells per row), and the cell count per column is calculated to fit the window aspect ratio well.
This hardcoded value must be hardcoded in the verilog file as well as the C++ file and the simulation does not run correctly if these values don't match.
Find a way to sync these values together. Maybe you want to read this value from a file and apply it in the verilog and C++ file during build / run time? A fancy custom preprocessor perhaps?
The wilder the idea, the better :D
Make sure to outline your idea roughly while asking to be assigned this issue.

This is a fun hobby project, so don't shy away from solutions that feel too hacky or whatever. If it'll be fun to work on, I'll approve it!

assign me this pls

@pratham-exe the issue has been assigned to you! Feel free to discuss your plan here :D

can i be assigned

can i be assigned

This issue has been assigned to @karun1763
Lemme know if you'll work on this or you've got something else going on :D

hey, can i be added to the queue for this issue?

@karun1763 any updates on the issue?

can i get assigned if this is still open?

can i get assigned if this is still open?

@ssether04 do you want this issue assigned to you?

Can i please be assigned to this issue ?

can u assign this to me

can u assign this to me

@Lohithsurya assigned!


AVRO-1881 - Avro (Java) Memory Leak when reusing JsonDecoder instance

@nandorKollar Interesting patch, can you rebase onto master?

Thanks for the clarification @nandorKollar


How to refresh a RequestView?

swift-request is brilliant , especially when using it with SwiftUI.
But I can't find a way to refresh a RequestView , cloud you give me some clue？
Thank.

Sort of a workaround, but too make something redraw in SwiftUI you need to update the State. You could add a query param and update it when you want to refresh it. Something like:
struct ContentView : View {
    @State private var refresh: Int = 0

    var body: some View {
        VStack {
            Button(action: { self.refresh += 1 }) { ... }
            RequestView(Request {
                ...
                Query(["refresh": refresh])
            }) { ... }
        }
    }
}


Favicon not showing under Opera

Favicon not showing for:
https://sebastiandedeyne.com/feed
http://laraveldaily.com/feed/
under Opera 58.0.3135.79 (Windows).

fixed issue preventing first one from working, second one doesn't have favicon currently


Getting 400 error from discovery URL and knowAuthority lientConfigurationError still an issue when using MSAL v2

Core Library
MSAL.js v2 (@azure/msal-browser)
Core Library Version
2.27.0
Wrapper Library
MSAL Angular (@azure/msal-angular)
Wrapper Library Version
2.3.3
Description
when using the Angular 12 sample I am getting error's regarding the known authority and discovery URL:
I have the spa application warning but the first error comes into that sign-on as well. To note, when using the default common that will work fine.
I've added the knownauthority but it seems like it isn't picking it up.
Also, is there a specific way to debug this in Angular?
Error Message
GET https://login.microsoftonline.com/common/discovery/instance?api-version=1.1&authorization_endpoint=<redact>/<redact>/b2c_1a_signup_signin/oauth2/v2.0/authorize 400 (

and this error:
ERROR Error: Uncaught (in promise): ClientAuthError: endpoints_resolution_error: Error: could not resolve endpoints. Please check network and try again. Detail: ClientConfigurationError: untrusted_authority: The provided authority is not a trusted authority. Please include this authority in the knownAuthorities config parameter.
ClientAuthError: endpoints_resolution_error: Error: could not resolve endpoints. Please check network and try again. Detail: ClientConfigurationError: untrusted_authority: The provided authority is not a trusted authority. Please include this authority in the knownAuthorities config parameter.

Msal Logs
How can I turn this on?
MSAL Configuration
Here is my configuration:

auth: {
      // clientId: '6226576d-37e9-49eb-b201-ec1eeb0029b6', // Prod enviroment. Uncomment to use.
      clientId: '<redact>', // PPE testing environment
      // authority: 'https://login.microsoftonline.com/common', // Prod environment. Uncomment to use.
      // authority: 'https://login.windows-ppe.net/common', // PPE testing environment.
      authority: 'https://<redact>/<redact>/<redact>',
      knownAuthorities: ['<redact>.b2clogin.com'],
      redirectUri: 'http://localhost:4200',
      postLogoutRedirectUri: 'http://localhost:4200'
    },
    cache: {
      cacheLocation: BrowserCacheLocation.LocalStorage,
      storeAuthStateInCookie: isIE, // set to true for IE 11. Remove this line to use Angular Universal
    },

### Relevant Code Snippets

```javascript
Listed above

Reproduction Steps

using the app to login by clicking login and either redirect or popup

Expected Behavior
For it to go to my login policy
Identity Provider
Azure B2C Custom Policy
Browsers Affected (Select all that apply)
Chrome, Edge
Regression
No response
Source
Internal (Microsoft)

Hi is there any update for this or suggestion for how to overcome this?

Hi @mpminayo I found the issue. I can't call it a bug because I don't know if that accurate but to me it's a bug because it broke the login.
So how did we get here. In msal-browser.js v 2.13.1 (which is the initial vanilla spa application implementation I used) worked fine. No issues. When I moved to the Angular v2 sample to test it out the error described above occurred. In my redact ie.,  I failed to explain that I am using a custom domain through a front-door policy.
So, the cadence being this https://<your-tenant-name>.b2clogin.com/your-tenant-name.onmicrosoft.com/your-signup-signin-policy also, then requires you to add in a known authority i.e., knownAuthorities. Which, I did add that after I got an error about it.
However, when I got the error the first time without the known authority the message was this.
core.js:6498 ERROR Error: Uncaught (in promise): ClientAuthError: endpoints_resolution_error: Error: could not resolve endpoints. Please check network and try again. Detail: ClientConfigurationError: untrusted_authority: The provided authority is not a trusted authority. Please include this authority in the knownAuthorities config parameter.
ClientAuthError: endpoints_resolution_error: Error: could not resolve endpoints. Please check network and try again. Detail: ClientConfigurationError: untrusted_authority: The provided authority is not a trusted authority. Please include this authority in the knownAuthorities config parameter.

when I added the knownAuthorities in I got this error message. Which as you can see, is the same error message.
core.js:6498 ERROR Error: Uncaught (in promise): ClientAuthError: endpoints_resolution_error: Error: could not resolve endpoints. Please check network and try again. Detail: ClientConfigurationError: untrusted_authority: The provided authority is not a trusted authority. Please include this authority in the knownAuthorities config parameter.
ClientAuthError: endpoints_resolution_error: Error: could not resolve endpoints. Please check network and try again. Detail: ClientConfigurationError: untrusted_authority: The provided authority is not a trusted authority. Please include this authority in the knownAuthorities config parameter.

To summarize, I has used this configuration:
https://<login.customdomain.com>/your-tenant-name.onmicrosoft.com/your-signup-signin-policy
knownAuthority:  ['<your-tenant-name>.b2clogin.com']
ERROR
core.js:6498...
Then, I went on a wild bug hunt (for days) and I went back to msal-broswer: 2.13.1 code base and tried to figure out why that was working but new upgrade wasn't.
I then reverted the package.json to go from msal-broswer: 2.27.0 to msal-broswer: 2.13.1. Made a few code comment outs so that it would run and boom it was working with my previously mentioned setup.
It then dawned on me how this probably is working and should be working. I figure through updates code integrity is improved.
First (went back to msal-browser: 2.27.0 and I reverted this:
**https://<login.customdomain.com>/your-tenant-name.onmicrosoft.com/your-signup-signin-policy**
knownAuthorities:  ['<your-tenant-name>.b2clogin.com']
to this:
**https://<your-tenant-name.b2clogin.com>/your-tenant-name.onmicrosoft.com/your-signup-signin-policy**
knownAuthorities:  ['<your-tenant-name.b2clogin.com>']
Now, it worked! FML
Then, I thought why does it not work when I use my custom domain and my base level knownAuthorities? What if I put a knownAuthorities with my custom domain ie., knownAuthorities: login.customdomain.com.
That worked. :|
So now, this worked
**https://<login.customdomain.com>/your-tenant-name.onmicrosoft.com/your-signup-signin-policy**
**knownAuthorities:  ['<login.customdomain.com>']**
SMH
What's odd to me is why does knownAuthorities take in an array when they are in function a 1 to 1 match? Meaning, I can only use 1 authority at a time, apparently, so what's the point of having multiple knownAuthorties? Would be interested in learning how I could get into such a scenario.
So, either this is a bug and or perhaps a feature. I'll let you explain that to me.

@xtianus79 What you arrived at is correct, in the case that the KnownAuthorities is a static array that informs MSAL JS of all the authorities an application would use in a given MSAL instance. The authorities added here should match the one used in the request/configuration for a successful token request.
Did you add both the URLs in KnownAuthorities and test if both the token calls pass?


No need to return bool here as we are not checking it

https://github.com/0xPolygon/polygon-edge/blob/db63825cc098961d90459682885d637ad2b8ab61/consensus/polybft/consensus_runtime.go#L661
It's enough to return err/nil

Addressed with #1027.


Provide a persistence backend for the model state data

Some data cannot be retrieved from the node manager and needs to be persisted somewhere:

the retrieved user information
the shared services
the sent invitations etc...

The proposal here is to reuse the LMDB storage for the user identity and to make it accessible from the AppState with an interface to store/load the model state data at startup and when modified.

Done with https://github.com/build-trust/ockam/pull/5432


how to use two contextQuery

Please use the following questions as a guideline to help me answer
your issue/question without further inquiry. Thank you.
Which version of Elastic are you using?
[ ] elastic.v3 (for Elasticsearch [2.x)]
Please describe the expected behavior
I have a suggester index.it contains two context. it  shows :
localhost:9200/suggester/suggest/_mapping -d '{
    "suggest": {
        "properties": {
            "name": {
                "type": "string"
            },
            "suggest": {
                "type": "completion",
                "analyzer": "simple",
                "search_analyzer": "simple",
                "payloads": true,
                "context": {
                    "app": {
                        "type": "category",
                        "default": 1
                    },
                    "add_app": {
                        "type": "category",
                        "default": 2
                    }
                }
            }
        }
    }
}'
while,in my project,I want to suggest it by contextQuery.the code is :
suggest_build:=elastic.NewCompletionSuggester("suggest")
suggest_build.Field("suggest")
suggest_build.Size(20)
suggest_build.ContextQueries(elastic.NewSuggesterCategoryQuery("app","1"))
suggest_build.ContextQueries(elastic.NewSuggesterCategoryQuery("add_app","2"))
but,this code build a json to es is :
"context":[{"app":"1"},{"add_app":2}]
this is wrong,the correct format is:
"context":{"app":"1","add_app":"2"}
this is why?I don't know how to deal with it.
Please describe the actual behavior
Any steps to reproduce the behavior?

According to Elasticsearch master branch, you are correct: It's a map (see here). I can't seem to find the toXContent that serializes the "context" in 2.3 though.
The code in Elastic that does it wrong is here. I will need to see if this is wrong/deprecated sometimes during 2.x. And if so, I will fix it on the next release.

case 1:
src, err := q.contextQueries[0].Source()
if err != nil {
return nil, err
}
suggester["context"] = src
default:
//ctxq := make([]interface{}, 0)
ctxq := map[string]interface{}{}
for _, query := range q.contextQueries {
src, err := query.Source()
if err != nil {
return nil, err
}
//ctxq = append(ctxq, src)
		for k, v :=range src.(map[string]interface{}) {
			ctxq[k] = v
		}

	}
	suggester["context"] = ctxq
}

this is correct,you can look

I'm about to release v3.0.45 and v2.0.52 which should fix this issue. Please comment here if that doesn't solve your problem. Thanks for contributing to Elastic.


fix: removed certain attributes from tracks

Fixes #1673
Changes:
Removed the description and location tag from realm for tracks.
Screenshots for the change:

@iamareebjamal @Shailesh351 @shreyasnbhat @mahikaw
please review.


Remove solaris from travis

Signed-off-by: Michael Crosby<EMAIL_ADDRESS>

Codecov Report

Merging #1511 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1511   +/-   ##
=======================================
  Coverage   40.82%   40.82%
=======================================
  Files          23       23
  Lines        2920     2920
=======================================
  Hits         1192     1192
  Misses       1451     1451
  Partials      277      277

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 63654f9...6d440dc. Read the comment docs.


CLAS: method sequence changes when editing via SE80

When editing classes via SE80, the method sequence typically reorders to alphabetical, this is getting annoying.
Guess the method sequence for the CS include is not stored properly when deserializing.
example: https://github.com/larshp/abapGit/pull/1567
similar old issue: https://github.com/larshp/abapGit/pull/987

looks like database table SEO_SRC_POS_IND is not updated during deserialization of CLAS objects(probably also INTF)

Looks like this is as SAP standard works, steps to confirm:
1: Delete zcl_abapgit_object_enqu in your system
2: Paste source https://github.com/larshp/abapGit/blob/6521d094707e43fe8621c11e3c5813b6ac5635e1/src/objects/zcl_abapgit_object_enqu.clas.abap as new class using ADT
3: Edit the class using the source based editor in SE80 => methods are shown in alphabetical order
so I guess this issue can be closed, everything works in ADT which is most important. Still suggest merging the fix for writing the source index


Not able to debug in VS - Microsoft.MixedReality.QR.pdb could not be found in the selected paths

Describe the bug
Symbol loading for Microsoft.MixedReality.QR.dll was skipped because it is not specified in the included modules list
To reproduce
Steps to reproduce the behavior:

Install  Microsoft.MixedReality.QR (NuGet) & MRTK
Try to debug

Expected behavior
We should be able to debug app with Microsoft.MixedReality.QR.dll
Screenshots

Your setup (please complete the following information)

Unity Version [e.g. 2020.3.3f1]
MRTK Version [e.g. v2.7]

Target platform (please complete the following information)

HoloLens 2

Additional context
Add any other context about the problem here.

Hey @whatever881, MRTK does not ship the QR library. It looks like the owner of the library either,

did not include the pdb file in the nuget package, or
did not publish it to the symbol server

I'll forward this to the QR library owner.

Hey @whatever881, this request has been routed. I'll update this issue when share how they intend to proceed.

Hi @whatever881 , I am working on adding symbols to the next release. In the meantime, you should still be able to debug your app by excluding the dll in the Visual Studio options

https://devblogs.microsoft.com/devops/understanding-symbol-files-and-visual-studios-symbol-settings/#configuring-visual-studios-settings


PHP: proto3 adoption

Fixes #6637
Fixes #6362
Step towards #5983

This is not ready to be merged yet. We need google/protobuf to add the tag v3.1.0-alpha-1 and release the package to Packagist/composer
Added the gRPC PHP Plugin to generate client service stub classes
Removed the previous stanley-cheung/Protobuf-PHP library and ruby dependency but if user decides to continue to use that library things will continue to work
Updated the Math generated code test, and interop tests
Removed the duplicated sources math.proto, test.proto, empty.proto, messages.proto. Now we can share the sources with src/protos
Updated jenkins PHP dockerfiles to use this new library, can now remove the ruby dependency.
Updated README
No change to the PECL extension

To test code generation, please run src/php/bin/generate_proto_php.sh.
From user's perspective, this is almost a drop-in replacement of the previous Protobuf-PHP library. See the changes in src/php/tests/generated_code/AbstractGeneratedCodeTest.php. Aside from a different code generator, all we need to change is to include the re-generated stub code, and the client code continues to work.
Next steps:

Update the examples/php directory helloworld greeter and route guide example. But that will need our grpc/grpc version 1.1 to be released to Packagist/composer first.
Update grpc.github.io website and change any reference to the old Protobuf-PHP library.

@TeBoring FYI

But protobuf not support php7 now and compile error on mac.

Closing this in favor of #8179


3 guidelines java

GUIDELINES.md path has been changed recently. All the commented issues are resolved now.


Release 1.5.0 - Alfajor

Required

[x] #862 Handle empty hook file or other OSErrors
[x] #834 Find the requested hook only
[x] #850 pre_gen hook doesn't appear to be loading custom extensions
[x] #856 Tests for custom extensions in hooks
[x] #858 Use click to process dict variable
[x] #861 Reproducible build with default config

Optional

[x] #791 add a jsonify filter to jinja default extensions
[x] #849 Remove pycache directories in make clean-pyc
[x] #855 Disable poyo logging for tests
[x] #859 Extend CLI help message

@audreyr @pydanny @michaeljoseph 🍪

🍪 @audreyr @pydanny @michaeljoseph 🍪

I can do the release, but I need a thumb from you ☺

:+1: :+1:

👏 think we are ready to 🚀

:+1:

@pydanny @michaeljoseph I'm getting a number errors when generating the long description for PyPI with restview. I vaguely remember that this was a problem last time as well, but I don't know how we solved it. Do we really need the full changelog on PyPI?
$ restview --long-description --pypi-strict
Duplicate explicit target name: "cookiecutter-pyqt5".

3379e99 does not look like this would resolve the errors I get now.

I propose to remove the changelog from the description, see #871

😂 https://github.com/audreyr/cookiecutter/releases/tag/1.5.0


More WebHostBuilderContext overloads

Add Context to WebHostBuilder so that extension methods can get to it, and add some missing overloads.
I renamed ConfigureConfiguration here so I can get some more feedback on the name, since everyone seems to hate it but nobody has any better suggestions.

This addresses https://github.com/aspnet/Hosting/issues/1014 and https://github.com/aspnet/Hosting/issues/1015

@Tratcher This is ready for a final look.

:up::date:


generate plots from command line

will solve parts of #250
Additionally it is possible to generate the plots directly from a csv file using
python main_out.py --gen_plots CSV_FILE --outp_dir OUTPUT_DIR

This was also documented in doc_benchmark.md

Codecov Report

Merging #254 (c230e36) into master (4cffbd9) will decrease coverage by 0.30%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master     #254      +/-   ##
==========================================
- Coverage   95.79%   95.49%   -0.30%
==========================================
  Files         127      127
  Lines        4326     4329       +3
==========================================
- Hits         4144     4134      -10
- Misses        182      195      +13

Flag
Coverage Δ

unittests
95.49% <100.00%> (-0.30%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

domainlab/arg_parser.py
98.82% <100.00%> (+0.04%)
:arrow_up:

... and 2 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more